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ROTATING EQUIPMENT DIAGNOSTIC SYSTEM- AND ADAPTIVE 

CONTROLLER 



The present invention* relates to process control and 
5 process monitoring, particularly to control and monitoring 
of rotating equipment through the use of machine status 
classification where, in one embodiment, adaptive control 
measures responsive to the machine status are implemented. 

As automation of production facilities and manufacturing 

XO processes has progressed, the number of human operators 
working with consistent attention to machines used in 
those facilities and processes has decreased; in 
compensating for this diminishing intimate involvement of 
operating technicians with the machines, quality control 

15 and quality assurance monitoring with computers programmed 
to mirror human logical and intuitive understanding has 
gained importance. Automatic diagnostic systems utilize 
pattern recognition, embedded rules, and functional 
relationships to characterize measurements of the 

20 monitored, machine in operation; and a human expert 
frequently is involved in helping to interpret the 
measurements. Expert rule sets, classifiers, neural 
network-based analysis, amd fuzzy-logic systems are 
gradually extending the productivity of human experts in 

25 providing automated systems which can generate routine 
feedback and status determination. As one example of a 
product in this area, Bently Nevada has developed Machine 
Condition Manager™ 2 000 (Machine Condition Manager is a 
trademark of Bently Nevada Corporation) using Gensym 

30 Corporation's (G2 is a trademark of Gensym 

Corporation) product . 
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An earlier important publication in this area of 
technology was the Dissertation "Classification of 
Vibration Signals By Methods of Fuzzy Pattern Recognition" 
(Klassif ikation von Schwingungs signal en mit Methoden der 
5 unscharfen Mustererkennung" ) by Dr. J. Strackeljan (a 

named inventor in this application) on June 4, 1993 at the 
Technical University of Clausthal. The work describes an 
approach and a foamialized methodology for a feature 
extraction process and classification algorithm as a basic 
10 element in a new type of integrated system for machine 

diagnosis and machine operation decision support. Other 
earlier feature selection publications of note are: 

Chang, C, ^Dynamic Prograinming as applied to Feature 
Subset Selection in a Pattern Recognition System", IEEE 
15 Transactions on Systems, Man and Cybernetics, 1973, No. 3, 
S. 166-171; 

Chien, Y.T., "Selection and Ordering of Feature 
Observations in a Pattern Recognition System", Information 
and Control, 1968, No. 12, pp. 394-414; 

20 Fu, K.S., "Sequential Methods in Pattern Recognition and 
Machine learning", Academic Press, New York, 1968; 

Fukianaga, K., "Repression of Random Processes using finite 
Karhuen-Loewe-E3cpansion" , Information and Control, Vol. 
25 16, 1970, S. 85—101; and 

Fukunaga, K. , "Systematic Feature Extraction", IEEE 
Transactions on pattern Analyses, Nr. 3, 1982. 
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One of the needs in use of classification systems relates 
to handling of anomalous measurements which do not 
initially appear to belong to any predefined status class. 
There is also a need for a machine diagnosis system which 
5 can be configured to diagnose a particular machine within 
a few days of the date of installation of the machine. 
Another emerging need in the art is for an approach which 
assimilates very large classification feature sets as the 
number of sensors (and the affiliated number of derived 

10 classification features) which can be simultaneously 

monitored by one CPU continues to increase. There is also 
an ongoing need for new feature types so that the 
diagnostic facility of the systems is rendered from an 
ever- improving datalogical reference frame. The 

15 Strackelj an Dissertation describes an approach for rapidly 
and efficiently resolving a large niimber of predictive 
features into a usefully defined subset of those features; 
this efficient approach is valuable in providing a basis 
for a system which can adapt its learning set in response 

20 to anomalous measurements even as it continues to provide 
real-time classification services. The present invention 
incorporates the approach described in the Strackelj an 
thesis along with further developments in providing 
solutions to all of the above- identified needs. 

25 Further features and details of the invention are 

appreciated from a study of the Figures and Detailed 
Description of the Preferred Embodiments . 

The invention provides a computer- implemented monitoring 
system, characterized by: 
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a toolbox of machine analysis data feature tools, each 
data feature tool having a predetermined set of candidate 
data features for a type of sensor and related machine 
component in a unified mechanical component assembly; 

means for designating one said data feature tool for 
classifying use respective to at least one defined class; 

means for measuring an input signal from said sensor; 

means for collecting a plurality of said measured input 
signals as a measured input signal set; 

means for obtaining a human-determined class affiliation 
parameter value for each measured input signal in said 
measured input signal set; 

means for calculating a feature value set respective to 
each measured input signal and respective to at least one 
data feature from said set of candidate data features; 

means for deriving a classifier reference parameters 
instance from the feature value set and associated human- 
determined class affiliation parameter values respective 
to said measured input signal set and from a plurality of 
said candidate data features; 

a classifier for defining a computer-determined class 
affiliation parameter value for a measured input signal 
respective to each class defined, said classifier in data 
communication with said classifier reference parameters 
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instance to define each computer-detezmined class 
affiliation parameter value; 

means for selecting a subset of data features from said 
candidate data features, said means for selecting in data 
5 communication with said measured input signal set, said 
associated human- determined class affiliation parameter 
values, said means for deriving a classifier reference 
parameter instance, and said classifier; 

means for retaining the classifier reference parameters 
10 instance respective to said selected subset of features as 
a real-time reference parameter set; 

means for graphically displaying at least one computer- 
determined class affiliation parameter value respective to 
an input signal measured in real-time from said assembly 
and respective to said real-time reference parameter set; 
and 

a real-time executive means for directing the operation of 
said means for measuring input signals, said means for 
calculating a feature value set, said classifier, and said 
means for graphically displaying so that a graphical 
display of at least one computer-determined class 
affiliation parameter value is implemented in real-time 
respective to an input signal measured in real-time from 
said assembly. 

The invention further provides a computer- implemented 
monitoring system, characterized by: 
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a toolbox of machine analysis data feature tools, each 
data feature tool having a predetermined set of candidate 
data features for a type of sensor and related machine 
component in a unified mechanical component assembly; 

means for designating one said data feature tool for 
classifying use respective to at least one defined class 
and a particular sensor; 



means for measuring an input signal from said sensor; 

means for determining at least-one computer-determined 
class affiliation parameter value for any said input 
signal respective to said candidate data features; 

means for graphically displaying said class affiliation 
parameter value respective to said input signal when 
measured in real-time from said assembly; and 



a real-time executive means for directing the operation of 
said means for measuring, said means for determining, and 
said means for graphically displaying so that a graphical 
display of at least one computer-determined class 
affiliation parameter value is implemented in real-time 
respective to an input signal measured in real-time from 
said assembly. 

The invention further provides a computer-implemented 
monitoring system for monitoring a sensor and related 
machine component in a mechanical component assembly, 
characterized by: 
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a predetermined set of candidate data features for 
. classifying said sensor respective to at least two defined 
classes ; 

5 means for real-time measurement of an input signal from 
said sensors- 
means for determining a first computer-determined class 
affiliation parameter value for said input signal from 

10 said candidate data feature set in reference to a first 

classifying parameter set respective to a first class, and 
a second computer-determined class affiliation parameter 
value for said input signal from said candidate data 
feature set in reference to a second classifying parameter 

15 set respective to a second class; 

means for deriving, during real-time measurement and class 
affiliation parameter value determination, a third 
classifying parameter set for said input signal respective 

20 to said first class and a fourth classifying parameter set 
for said input signal respective to said second class when 
all computer-determined class affiliation parameter values 
respective to an input signal measurement in real-time 
have a quantity less than a predetermined threshold value, 

25 said third and fourth classifying parameter sets 
incorporating the influence of said input signal 
measurement ; and 

means for replacing said first and second classifying 
30 parameter sets respectively with said third and fourth 

classifying parameter sets so that said third and fourth 
classifying parameter sets respectively become new said 
first and second classifying parameter sets when said 

-7- 



StXXID: <WO_0198849A2_I_> 



5 



wo 01/98849 _ _ pcT/uSOl/,7308 



third and fourth classifying parameter sets have been 
derived . 

The invention further provides a computer- implemented 
system for classifying a type of sensor and related 
machine component in a unified mechanical component 
assembly, characterized by: 



means for deriving a dimensionless peak amplitude data 
feature ; 



means for measuring an input signal from said sensor; 

10 means for obtaining a class affiliation parameter value 
for said measured input signal respective to said 
dimensionless peak amplitude feature. • 

The invention further provides a computer- implemented 
system for classifying a type of sensor and related 
15 machine component in a unified mechanical component 
assembly, characterized by: 

means for deriving a dimensionless peak separation 
feature ; 

means for measuring an input signal from said sensor; 



20 



means for obtaining a class affiliation parameter value 
for said measured input signal respective to said 
dimensionless peak separation feature. 
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The invention further provides a computer- implemented 
method, characterized by the steps of ; 

providing a toolbox of machine analysis data feature 
tools, each data feature tool having a predetermined set 
5 of candidate data features for a type of sensor and 
related machine component in a unified mechanical 
component assembly; 

designating one said data feature tool for classifying use 
respective to at least one defined class; 

10 measuring an input signal from said sensor; 

collecting a plurality of said measured input signals as a 
measured input signal set; 

obtaining a human-determined class affiliation parameter 
value for each measured input signal in said measured 
15 input signal set; 

calculating a feature value set respective to each 
measured input signal and respective to at least one data 
feature from said set of candidate data features; 

deriving a classifier reference parameters instance from 
20 the feature value set and associated hioman- determined 
class affiliation parameter values respective to said 
measured input signal set and from a plurality of said 
candidate data features; 
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using a classifier in defining a computer- determined class 
affiliation parameter value from said classifier reference 
parameters instance for a measured input signal respective 
to each class defined; 



selecting a subset of data features from said candidate 
data features, said measured input signal set, said 
associated human- determined class affiliation parameter 
values, a plurality of said derived classifier reference 
parameter instances, and said classifier by evaluating a 
plurality of data feature combinations until acceptable 
classification is achieved; 

retaining the classifier reference parameters instance 
respective to said selected subset of features as a real- 
time reference parameter set; 

classifying in real-time said measured input signal from 
said real-time reference parameter set to establish a 
real-time computer -determined class affiliation parameter 
value; and 



graphically displaying in real-time said real-time 
computer-determined class affiliation parameter value 
that a graphical display of at least one computer- 
determined class affiliation parameter value is 
implemented in real-time respective to an input signal 
measured in real-time from said assembly. 

The invention further provides a computer-implemented 
method, characterized by the steps of; 
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providing a toolbox of machine analysis data feature 
tools, each data feature tool having a predetermined set 
of candidate data features for a type of sensor and 
related machine component in a unified mechanical 
5 component assembly; 

designating one said data feature tool for classifying use 
respective to at least one defined class and a particular 
sensor; 

measuring an input signal from said sensor; 

10 determining at least-one computer-determined class 

affiliation parameter value for any said input signal 
respective to said candidate data features; 

graphically displaying said class affiliation parameter 
value respective to said input signal when measured in 
15 real-time from said assembly; and 

directing the operation of said steps of measuring, 
determining, and graphically displaying so that a 
graphical display of at least one computer-determined 
class affiliation parameter value is implemented in real- 
20 time respective to an input signal measured in real-time 
from said assembly. 

The invention further provides a computer- implemented 
method for monitoring a sensor and related machine 
component in a mechanical component assembly, 
25 characterized by the steps of: 
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providing a predetermined set of candidate data features 
for classifying said sensor respective to at least two 
defined classes; 

measuring in real-time an input signal from said sensor; 

5 determining a first computer-determined class affiliation 
parameter value for said input signal from said candidate 
. data feature set in reference to a first classifying 
parameter set respective to a first class; 

determining a second computer-determined class affiliation 
10 parameter value for said input signal from said candidate 
data feature set in reference to a second classifying 
parameter set respective to a second class; 

deriving, during said real-time measuring and determining 
steps, a third classifying parameter set for said input 
signal respective to said first class and a fourth 
classifying parameter set for said input signal respective 
to said second class when all computer-determined class 
affiliation parameter values respective to an input signal 
measurement in real-time have a quantity less than a 
predetermined threshold value, said third and fourth 
classifying parameter sets incorporating the influence of 
said input signal measurement; and 

replacing said first and second classifying parameter sets 
respectively with said third and fourth classifying 
25 parameter sets so that said third and fourth classifying 
parameter sets respectively become new said first and 
second classifying parameter sets when said third and 
fourth classifying parameter sets have been derived. 
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The invention further provides a computer- implemented 
method for classifying a type of sensor and related 
machine component in a unified mechanical component • 
assembly, characterized by: 

5 deriving a dimensionless peak amplitude data feature; 
measuring an input signal from said sensors- 
obtaining a class affiliation parameter value for said 
measured input signal respective to said dimensionless 
peak amplitude feature. 

10 The invention further provides a computer- implemented 
method for classifying a type of sensor and related 
machine component in a unified mechanical component 
assembly, characterized by: 

deriving a dimensionless peak separation feature; 

15 measuring an input signal from said sensor; 

obtaining a class affiliation parameter value for' said 
measured input signal respective to said dimensionless 
peak separation feature. 

The invention further provides a computer- implemented 
20 method for classifying a type of sensor and related 
machine component in a unified mechanical component 
assembly, characterized by the steps of: 
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defining a feature set for classification from a set of 
candidate features and a learning database using 
evolutionary selection, said learning database having a 
set of evaluated instances, said evolutionary selection 
5 having the sequential operations of : 

defining a population size for a population of 
feature combination instances; 

defining a set of evaluation features for said 
population from said set of candidate features; 

defining an evaluation feature set size; 

randomly selecting, from said candidate 
features, a population instance of feature set 
instances of said evaluation feature set size, 
said population instance having said population 
15 size; 

training a classifier according to said 
population instance and said learning database; 

evaluating the prediction capability of each 
feature set instance using said trained 
20 classifier; 

designating said feature set instance as a real- 
time classif jLcation feature set if said 
evaluating fulfills a criteria; 
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selecting, if said criteria is unfulfilled, a 
subset group of said feature set instances 
according to said evaluated prediction 
capabilities ; 

5 generating a child subset group of said feature 

set instances by randomly selecting one of said 
features from each of two randomly chosen 
feature set instances and combining each of said 
selected features into a new feature set 
10 instances- 



mutating said new feature set instance by 
randomly selecting one of said features in said 
new feature set instance and replacing said 
selected feature with a randomly selected 
15 feature from said set of evaluation features for 

said population with the proviso that said 
replacement feature is other than either of said 
features in said new feature set instance prior 
to initiation of said mutating operation; 

20 defining a new population instance from said 

subset group and at least one said mutated 
feature set instance with the proviso that said 
mutating operating is executed until said new 
population instance achieves said population 

25 size; and 

returning to said training operation; 

acquiring a set of features in real-time from said sensor; 
and 
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classifying said acquired set of features hy using said 
real-time classification feature set. 

Other features, advantages, and benefits of the invention 
are readily apparent from the detailed description of the 
5 preferred embodiments when taken in connection with the 
accompanying drawings. 

Figure 1 presents a block diagram of the monitoring system 
and auxiliary systems as they operate and monitor a 
manufacturing apparatus. 

• 10 Figure 2 shows detail in the galvanic isolation and signal 
filtering board. 

4 

Figure 3 shows the band pass filter circuit used on the 
galvanic isolation and signal filtering board. 

Figure 4 presents a block flow overview of key logical 
15 components of the monitoring system. 

Figure 5 presents a block flow overview of signal 
conditioning logical components of the monitoring system. 

Figure 6 presents a block flow diagram of the real-time 
executive logic in the monitoring system. 

20 Figure 7 presents detail of functions performed at the 
direction of the real-time control block. 

Figure 8 presents a block flow diagram of the human 
interface logic in the monitoring system. 
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Figures 9A and 9B present a block flow diagram of the 
pattern recognition logic in the monitoring system. - 

Figure 10 presents detail in a decision function set of 
the pattern recognition logic. 

5 Figure 11 presents a block flow diagram of the signal and 
data I/O and logging logic in the monitoring system. 

Figure 12 presents detail in the tool-specific feature 
derivation f iinctions . 

Figure 13 presents a block flow diagram of the reference 
10 data logic in the monitoring system. 

Figure 14 presents details for a machine analysis toolbox. 

Figure 15 presents an overview flowchart of the 
organization of key information in constructing and using 
preferred embodiments. 

15 Figure 16 presents a flowchart of key classification 
steps. 

Figure 17 presents a flowchart detailing decisions in use 
of progressive feature selection, evolutionary feature 
selection, neural network classification, and weighted 
20 distance classification. 

Figure 18 presents detail in the weighted distance method 
of classifying and progressive feature selection. 
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Figure 19 illustrates auxiliary detail in the progressive 
feature selection process of Figure 18. 

Figure 20 presents detail in the neural network method of 
classifying and in evolutionary feature selection. 

5 Figures 21A-21D illustrate detail in an evolutionary 
feature selection example. 

Figure 22 presents an overview of interactive methods and 
data schema in the preferred embodiments for use of the 
weighted distance classification method and a progressive 
10 feature selection methodology. 

Figure 23 presents an overview of interactive methods and 
data schema in the preferred embodiments for use of the 
■ neural network classification method and an evolutionary 
feature selection methodology. 

15 Figure 24 presents a unified mechanical assembly of 
machine components and attached sensors. 

Figure 25 presents a block flow summary showing toolbox 
development information flow for a particular set of 
unified mechanical assemblies and machine components. 



20 



Figure 26 presents a view of key logical components, 
connections, and information flows in use of the 
monitoring system in a monitoring use of the preferred 
embodiment . 
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Figure 27 presents a view of key logical components, 
connections/ and information flows in use of the 
monitoring system in an adaptive control use of the 
preferred embodiment. 

5 Figure 2 8 shows an example of a graphical icon depiction 
of class affiliation parameter values in normalized form. 

Figure 29 shows an example of a graphical icon depiction 
of class affiliation parameter values in non-normalized 
form. 

10 In describing the preferred embodiments, a number of 
^^logical engines" (''^engines'') are ^characterized in 
interaction with data structural elements. In this regard, 
computer- implemented logical engines generally reference 
virtual functional elements within the logic of a computer 

15 which primarily perform tasks which read data, write data, 
calculate data, and perform decision operations related to 
data. '''Logical engines" ( engines " ) optionally provide 
some limited data storage related to indicators, counters, 
and pointers, but most data storage within computer- 

20 implemented logic is facilitated within data structural 
elements (data schema) which hold data and information 
related to the use of the logic in a specific instance; 
these data structural element logical sections are 
frequently termed as '^tables", '"databases", ''data 

25 sections", and/or "data commons". Data structural 

elements are primarily dedicated to holding data instead 
of performing tasks on data and usually contain a 
generally-identified stored set of information. ''Logical 
engines" ("engines") within computer- implemented logic 

30 usually perform a generally identified function. As a 
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design consideration, the use of both logical engines and 
logical tools within a logical system enables a useful 
separation of the logical system into focused or 
abstracted subcomponents which can each be efficiently 
considered, designed, studied, and enhanced within a 
separately focused and distinctively particularized 
context. AS should be apparent, some of the logical 
internal systems represent distinctive areas of specialty 
in their own right, even as they are incorporated into the 
comprehensive and holistic system represented by each of 
the described embodiments. In one context, specific 
engines are individual executable files, linked files, and 
subroutine files which have been compiled into a unified 
logical entity. Alternatively, specific engines are 
combinations of individual executable files, linked files, 
subroutine files, and data files which are datalogically ' 
linked either in unified form or in a dynamically 
associated manner by the operating system during 
execution. 



20 



25 



30 



The specification also references the term "Real-Time" 
(real-time, real time. Real-time); to facilitate clarity, 
the following paragraph presents a discussion of the Real- 
Time concept. 

Real-time computer processing is generically defined as a 
method of computer processing in which an event causes a 
given reaction within an actual time limit and wherein 
computer actions are specifically controlled within the 
context of and by external conditions and actual times. 
As an associated clarification in the realm of process 
control, real-time computer-controlled processing relates 
to the performance of associated process control logical, 
decision, and quantitative operations intrinsic to a 
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process control decision program functioning to monitor 
and modify a controlled apparatus implementing a real-time 
process wherein the process control decision program is 
periodically executed with fairly high frequency usually 
having a period of between 10 ms and 2 seconds, although 
other time periods are also utilized. In the case of 
"advanced" control routines (such as the classifier of the 
described embodiments) where a single solution instance 
requires more extended computational time, a larger period 
is essentially necessary (frequency in determination of 
changes in control element settings should be executed at 
a frequency equal-to-or-less-than the frequency of 
relevant variable measurement) ; however, an extended 
period for resolution of a particular value used in 
control is still determined in real-time if its period of 
determination is repetitive on a reasonably predicable 
basis and is sufficient for utility in adaptive control of 
the operating mechanical assembly. 

A measuring sensor attached to an apparatus usually 
20 outputs a voltage or voltage equivalent responsive to an 
attribute of the operational apparatus (for example, an 
open valve or an energized p\imp) and/or conditions (for 
example, fluid temperature or fluid pressure) in the 
materials operationally processed by the apparatus . 

2 5 A signal (measured signal) represents the magnitude of the 
voltage either as a data value at a particular moment of 
time or, alternatively, as a set of data values where each 
data value has an explicit or implicit (via sequential 
ordering) association with a time attribute. The term 

30 "'signal " in many instances also references the voltage or 
voltage history as converted to data value 
representation . 
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The signal is evaluated in the context of a function to 
derive specific signal function attributes; these signal 
attributes are also termed features (Features) both (a) as 
a descriptive term generally and also (b) as a reference 
variable in pat tern -matching processes such as 
"classification". in this regard. Features frequently 
reference a variable possessing a joining consideration or 
datalogical nexus between (a) an attribute derived in the 
context of a function from the measured signal and (b) a 
variable used in a classifier. A feature value generally 
represents a particular quantitative data value which has 
been assigned-to and associated-with a feature variable 
respective to a signal measurement instance. 

Classifiers generally associate features - more 
specifically, patterns of features - with a membership 
(association, belonging, and/or affiliation) of the 
operational apparatus (generating the features) in a 
particular momentary status of identified useful 
categorization (a class) ,- in this regard, membership is 
either (a) a designation, in one context, of belonging to 
the class or (b) a designation, in an alternative context, 
of not belonging to the class. Classes frequently are 
representative of human quality evaluations and/or 
judgements (for example a "good" class, a «bad" class, 
and/or a "transitional" class which represent, 
respectively, a «good» state of operational performance, a 
"bad- state of operational performance, and/or an 
"uncertain or transitioning" state of operational 
performance) . Membership also references a degree of 
belonging to a class - for example in a two class 
evaluation,, a degree of affiliation with the two classes 
is characterized as "the current state of the system is 90 
percent ^good' and 10 percent ^bad' " ; more precisely, the 
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concept of sharpness" further references the 
quantitative confidence with which a particular classified 
measurement instance (in the context of its affiliated 
classifying feature set) is clearly affiliated with any 
5 class of the set of candidate classes for which membership 
is derived. 

In classifying, Weighted Distance Classification and 
Euclidian Distance Classification reference certain 
overlapping situations; accordingly, references to 

10 Weighted Distance Classification herein implicitly 
includes appropriate use of Euclidian Distance 
Classification in the context of these similarities- In 
this regard, classification performance strongly depends 
on the ability of a particular classifier to adapt the 

15 distribution of a particular learning sample in an optimal 
manner. If a set of learning samples is represented in an 
essentially spherical distribution for all classes, the 
Euclidian metric is sometimes used. If the distribution 
is ellipsoidal. Weighted Distance approaches are optimal 

20 in coordinate directions weighted individually. In this 
regard/ marginal samples are appraised similarly 
respective to different Euclidian distances. Essentially, 
the Euclidian metric is a special form of a Weighted 
Distance metric (when the weights are essentially equal 

25 for all directions) ; the inventors prefer, therefore, the 
use of a weighted disteuice classifier in general. 

Turning now to the figures. Figure 1 presents a block 
diagram of the monitoring system and auxiliary systems as 
they operate and monitor a manufacturing apparatus . 
30 System Overview 100 presents key physical components in an 
fully applied embodiment. Monitor 102 provides a monitor 
for h-uman (operator technician and configuration expert) 
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Viewing of information and data. Process Information 
System 104 provides a process information system (a system 
for retaining and depicting information to operating 
technicians about data executing in an affiliated, 
attached, and interconnected real-time control system or 
group of real-time control systems but which is not under 
the highly rigorous real-time response cadence of a real- 
time control system for its communications) in bilateral 
data communication via Communications Interface 10 6 with 
Control Computer 108. Process Information System 104 
incorporates Process Information CPU 134 for execution of 
Process Information Logic 136. Communications Interface 
106 incorporates Communication Interface CPU 13 0 for 
execution, of Communication Interface Logic 132. Control 
Computer 108 incorporates Control Computer CPU 126 for 
execution of Control Computer Logic 128 in real-time 
operational monitoring and control of Mechanical Assembly 
124. Classification Computer System 110 provides 
Classification Computer CPU 13 8 for executing 
Classification Computer Logic 140 in implementing 
classification of the status of Mechanical Assembly 124. 
System Overview 100 is in bilateral data communication 
with Process Information System 104 for receiving a 
portion of input data as a data stream and for 
communicating the classification status of Mechanical 
Assembly 124 to Control Computer 108 so that Control 
Computer 108 controls Mechanical Assembly 124 in adaptive 
response to the classified status. Classification 
Computer System 110 also receives input data from Analog 
Input Signal 118 and Digital Input Signal 116 via Signal 
Filtering Board 114 and Data Acquisition Board 112. Data 
Acquisition Board 112 incorporates Analog- to-Digital- 
Converter Circuit 142 to effect conversion of analog 
voltages from Signal Filtering Board 114 into digital 
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data. Signal Filtering Board 114 incorporates Band-Pass- 
Filter Circuit 144 as further described in Filter Circuit 
Components 200 and Filter Circuit 300 of Figures 2 and 3. 
Digital Input Signal 116 is provided both as a direct 
signal to Signal Filtering Board 114 and to Control Signal 
Input Circuitry 148 where Control Signal Input Circuitry 
148 is synchronous with the needs of Control Computer 108. 
Analog Input Signal 118 is provided both as a direct 
signal to Signal Filtering Board 114 and to Control Signal 
Input Circuitry 148 where Control Signal Input Circuitry 
148 is appropriately synchronous with Control Computer 
108. Digital Output Signal 120 and Analog Output Signal 
122 provide output command signals from Control Signal 
Output Circuitry 150 to Mechanical Assembly 124 so that 
Control Computer 108 implements manipulated variables to 
modify attributes of Mechanical Assembly 124 and thereby 
control the operation of Mechanical Assembly 124 in real- 
time. An example of Control Computer 108 is described in 
WO Publication No. 00/65415, dated November 2, 2000, 
entitled PROCESS CONTROL SYSTEM WITH INTEGRATED SAFETY 
CONTROIi SYSTEM" • 

Mechanical Assembly 124 is a mechanical component 
assembly, which benefits from Classification Computer 
System 110 (1) by the provision of information to an 
operating technician of the classified status of the 
operating assembly and (2) , optionally, by the 
incorporation of the classified status into control 
decisions effected by Control Computer Logic 128. The 
classified status is communicated to Control Computer 
Logic 128 via Process Information System 104 and 
Communications Interface 106. Mechanical Assembly 124 is, 
alternatively, in example and without limitation, a motor, 
a gearbox, a centrifuge, a steam turbine, a gas turbine, a 
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gas turbine operating with the benefit of wet compression, 
a chemical process, an internal combustion engine, a 
wheel, a furnace, a transmission, or an axle. With 
respect to wet compression, US Patent 5,867,977 for a 
"Method and Apparatus for Achieving Power Augmentation in 
Gas Turbines via Wet Compression" which issued on February 
9, 1999 to Richard Zachary and Roger Hudson and also US 
Patent 5,930,990 which issued on August 3, 1999 to the 
same inventors provide a useful teaching of a gas turbine 
operating with the benefit of wet compression. 

Network 146 is in bilateral data communication with 
Classification Computer System 110 and provides an 
interface via network with other systems. In an 
alternative embodiment. Process Information System 104 
interfaces with Classification Computer System 110 via 
Network 146; in a further alternative embodiment. 
Communications Interface 106 interfaces with 
Classification Computer System 110 via Network 146. 
Control Signal Input Circuitry 148 generically references 
a set of circuits which are respectively specific to 
Digital Input Signal 116 and Analog input Signal 118 in 
interfacing to Control Computer 108. 

Details in Process Information System 104, Communications 
interface 106, Control Computer 108, Network 146, and Data 
Acquisition Board 112 should be apparent to those of 
skill and are presented here briefly to enable a framed 
understanding of preferred embodiments and their use. 
Details in Classification Computer Logic 140 and Signal 
Filtering Board 114 are focal in most subsequent 
3 0 discussion in this specification. 
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Figure 2 shows detail in the galvanic isolation and signal 
filtering board. Filter Circuit Components 20 0 shows 
further detail in Signal Filtering Board 114, Frequency 
Module 2 02 presents construction details in Frequency 
5 Modules 206. Band-Pass-Filter Circuitry Board 204 shows 
an embodiment of Signal Filtering Board 114 with a set of 
Frequency Modules 206, a set of Transformers 208, and a 
set of Input Capacitors 210 in electrical mounting as 
shown. As previously noted, a instance of Frequency 

10 Modules 20 6 is further detailed in Frequency Module 202 
which is provided in 5 separate instances on Band-Pass- 
Filter Circuitry Board 204. Transformer 208 is provided 
in 5 separate instances on Band-Pass-Filter Circuitry 
Board 204. Input Capacitors 210 are also provided in 5 

15 separate instances on Band- Pass-Filter Circuitry Board 
204. Signal Wire Terminators 212 provide 5 separate 
wiring terminations for use in interfacing 5 separate 
instances of Analog Input Signal 118 to Data Acquisition 
Board 112 . It should be noted that Digital Input Signal * 

20 116 is optionally routed in a pass-through manner to 

Classification Computer System 110 via Signal Filtering 
Board 114 and Data Acquisition Board 112, but most signals 
used by Classification Computer System 110 are of the 
Analog Input Signal 118 type. Frequency Capacitor ^'a'' 

25 214, Frequency Capacitor '^b'' 218, and Frequency Capacitor 
''c" 222 provide respective first, second, and third 
capacitors in Frequency Module 202. Frequency Inductor 
^^a" 216 and Frequency Inductor ^^b" 220 provide respective 
first and second inductors in Frequency Module 202. 

30 Figure 3 shows the band pass filter circuit used on the 
galvanic isolation and signal filtering board. Filter 
Circuit 300 shows one band pass filter circuit which is 
established by the combination of Input Capacitors 210 
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instance CI, Transformers 2 08 instance Tl, and Frequency 
Modules 206 instance Ml with Cai mapping to Frequency 
Capacitor «a" 214, Lai mapping to Frequency Inductor "a" 
216, Cbi mapping to Frequency Capacitor "b" 218, Lbi mapping 
to Frequency Inductor "b" 220, and Cci mapping to Frequency 
Capacitor "c" 222. These are preferably characterized 
according to the following criteria of Table 1: 
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Table! 

Upper cut-off frequency: fg = 2 Khz 



C210 

Cb 

Co 



lO^iF/lOOV 
330 nF/lOOV 
330 nF/lOOV 
330 nF/lOOV 



La 

U 



47 nH 
47 nH 



T 208 ST 6353 (signal transformer) 

La, Lb: Micro coils 



Upper Cut-off Frequency fg = 20 Khz 



€210 
Cb 

Cc 



lOflF/lOOV 

47 nP/lOOV 
47 nP/lOOV 
47 tiF/lOOV 



La 

Lb 



47 hH 
47 HH 



In one embodiment having two instances of Band-Pass-Filter 
Circuitry Board 204, a beneficial arrangement of Band- 
Pass-Filter Circuit 144 instances is shown in Table 2. 

25 Table 2 

Band-Pass-Filter Circuit 144 Configuration 



Channel 
212 


Frequency 


SO 


20 Khz 


SI 


20 Khz 


S2 


20 Khz 


S3 


2 Khz 


S4 


2 Khz 


S5 


20 Khz 


S6 


20 Khz 


S7 


20 Khz 


S8 


2 Khz 


S9 


2Khz 
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Figure 4 presents a block flow overview of key logical 
components of the monitoring system. Classifying Logic 40 0 
provides a first nested opening of Classification Computer 
Logic 140. Real-Time Executive Logic 402 is in bilateral 
5 data communication with Reference Data Logic 404, Human 
Interface Logic 412, Pattern Recognition Logic 406, and 
Signal I/O Logic 408 and is further discussed with respect 
to Real-Time Logic Detail 600 and Real-Time Function 
Detail 700 of Figures 6 and 7. As should be apparent, 

10 Real-Time Executive Logic 402 provides execution 
enablement data signals and multi-process and/or 
multitasking interrupts to all engines and other 
executable logic of Reference Data Logic 404, Human 
Interface Logic 412, Pattern Recognition Logic 4 06, and 

15 Signal I/O Logic 408 as needed and receives feedback and 
flagging inputs so that responsive logic is executed in a 
xinified and coordinated real-time cadence. Reference Data 
Logic 404 also is in bilateral data communication with 
Human Interface Logic 412 and Pattern Recognition Logic 

20 406 and is further discussed with respect to Reference 
Data Detail 1300 and Toolbox 1400 of Figures 13 and 14. 
Pattern Recognition Logic 40 6 also is in bilateral data 
communication with Signal I/O Logic 408 and Human 
Interface Logic 412 and is further discussed with respect 

25 to Pattern Recognition Logic Detail 900 and Decision 

Function Detail 1000 of Figures 9A, 9B, and 10. Signal 
I/O Logic 408 also is in bilateral data comm\inication with 
Human Interface Logic 412 and is in data reading 
communication with Signal Conditioning Logic 410 and is 

30 further discussed with respect to Signal Logic Detail 1100 
and Derivation Functions 1200 of Figures 11 and 12. 
Signal Conditioning Logic 410 reads Analog Input Signal 
118 and Digital Input Signal 116 and provides values via 
read access to Signal I/O Logic 408; this logical section 
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is further discussed respective to Signal Conditioning 
Detail 500 of Figure 5. Human Interface Logic 412 
interfaces to Monitor 102 to provide an interface with 
operating technicians; this logic is further detailed in 
the discussion respective to Interface Logic Detail 800 of 
Figure 8 . 
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30 



Figure 5 presents a block flow overview of signal 
conditioning logical components of the monitoring system. 
Signal Conditioning Detail 500 provides fur^ther detail in 
Signal Conditioning Logic 410 and also reprises Signal I/O 
Logic 408 along with Analog Input Signal 118 and Digital 
Input Signal 116 for reference. Analog Signal Input 
Buffer 504 holds data from Analog Value Input Logic 510 so 
that Signal I/O Logic 408 can read the data in a timely 
manner. Digital Signal Input Buffer 506 holds data from 
Digital Value Input Logic 508 so that Signal I/O Logic 408 
can read the data in a timely manner. Digital Value Input 
Logic 508 provides a logical engine for real-time ■ . - . - 
acquisition of Digital Input Signal 116 and interface of 
Digital input Signal 116 to Digital Signal input Buffer 
506. It is again noted that use of Digital Input Signal 
116 is relatively minimal at this time in the described 
embodiments, but use of Digital Input Signal 116 signals 
is certainly possible in certain contemplated 
circumstances (for example, without limitation, a machine 
"trip" indicator) . The Analog Value Input Logic 510 
engine provides logic necessary for real-time operation of 
Analog-to-Digital-Converter Circuit 142 and interface of 
Analog input Signal 118 to Analog Signal Input Buffer 504. 

Figure 6 presents a block flow diagram of the real-time 
executive logic in the monitoring system. Real-Time Logic 
Detail 600 provides further detail in Real-Time Executive 

-30- 



3DOCID: <WO 0198a«A2_L> 



wo 01/98849 



PCT/USOl/17308 



Logic 402 and also reprises Reference Data Logic 404, 
Pattern Recognition Logic 406, Human Interface Logic 412, 
and Signal I/O Logic 408 for reference. Real-Time 
Executive Engine 602 contains Control Block 604 for 
providing cadenced execution of Classification Computer 
Logic 140. In this regard. Control Block 604 contains 
sub-logic for substantially directing Classification 
Computer CPU 13 8 to implement Classifying Logic 400 in 
achieving the goals of the classifying system using either 
multi-process or multi-tasking approaches. Control Block 
604 interfaces with routines in Function Set 606 in 
implementation of Classification Computer Logic 140. 
Further detail in Function Set 606 is presented in the 
discussion with respect to Real-Time Function Detail 7 00 
of Figure 7 . Control Block 604 is also responsive to 
status indicators as indicated in Mode ID 608. The 
''Configure'^, Learn " , and ''Run" modes of operation are 
defined in one embodiment via input from Human Interface 
Logic 412 with human designation of the particular active 
mode at any particular time. 

Figure 7 presents detail of functions performed by use of 
the real-time control block. Real-Time Function Detail 
700 shows further detail in Function Set 606. In this 
25 regard, the internal functions of Function Set 606 are in 
bilateral data communication (that is, data read 
communication and data write communication in both 
directions as appropriate) with Control Block 604. 
Hardware Configuration Function 702 provides code in 
3 0 interfacing Human Interface Logic 412 to Signal I/O Logic 
408 for configuring Classification Computer System 110 to 
a particular set of Analog Input Signals 118 and Digital 
Input Signals 116. Sample Collection Fianction 704 
provides code in interfacing Human Interface Logic 412 and 
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10 



Signal I/O Logic 408 in acquiring sample data for use in 
customizing System Overview 100 to a particular Mechanical 
Assembly 124. Database Acquisition Function 706 provides 
code in interfacing Human Interface Logic 412 and 
Reference Data Logic 404 to load learning databases into 
system 110. Tool Selection Function 708 provides code in 
interfacing Human Interface Logic 412 and Reference Data 
Logic 404 to define tools for use with particular signals. 
Component Selection Fxinction 710 provides code in 
interfacing Human Interface Logic 412 and Reference Data 
Logic 404 in defining components which can then define 
tools. Feature Calculation Function 712 provides code in 
interfacing Reference Data Logic 404 and Signal I/p Logic 
408 to calculate features for use -in Pattern Recognition 
15 Logic 40 6. Feature Selection Function 714 provides code 
in interfacing Reference Data Logic 404 and Pattern 
Recognition Logic 406 in selecting features for 
classification use. Learning Function 716 provides code 
in interfacing Reference Data Logic 404, Human Interface 
20 Logic 412, and Pattern Recognition Logic 406 in 

implementing a learning process to acquire a learning 
database. Classifier Definition Function 718 provides 
code in interfacing Reference Data Logic 404, Hxoman 
Interface Logic 412, and Pattern Recognition Logic 406 in 
25 defining a classifier. Real-Time Characterization 

Function 72 0 provides code in interfacing Reference Data 
Logic 404, Signal I/O Logic 408, Pattern Recognition Logic 
406, and Human Interface Logic 412 in implementing real- 
time membership value determinations to classify 
30 Mechanical Assembly 124 in operation. Adaptation Function 
722 provides code in interfacing Human Interface Logic 
412, Reference Data Logic 404, Pattern Recognition Logic 
406, and Signal I/O Logic 408 in implementing adaptation 
of the classifying system in real-time to assimilate 

-32- 



3DOCID: <WO_0198a48A2_l_> 



wo 01/98849 




PCTAJSOl/17308 



learning related to measured signals or data which are not 
classifiable to an acceptable confidence with the existing 
classifier. Network Interfacing Function 724 provides 
code in interfacing Signal I/O Logic 408 and Human 
5 Interface Logic 412 with Network 146 or Process 

Information System 104. Display Function 726 provides 
code in interfacing Signal I/O Logic 408 and Human 
Interface Logic 412 and further in interfacing Human 
Interface Logic 412 and Monitor 102 so that an operating 
10 technician is apprised of the classification status of 
Mechanical Assembly 124 in operation. 

Figure 8 presents a block flow diagram of the human 
interface logic in the monitoring system. Interface Logic 

15 Detail 800 presents expanded detail of Human Interface 

Logic 412. Real-Time Executive Logic 402, Reference Data 
Logic 404, Signal I/O Logic 408, and Pattern Recognition 
Logic 4 06 are reprised from Figure 4. Graphical Output 
Engine 802 is in bilateral data communication with Real- 

20 Time Executive Logic 402 for (1) data write communicating 
the occurrence of anomalous measured vectors (to 
Adaptation Function 722) as determined by Rework Engine 
810 (and communicated from Associative Value Engine 812) , 
(2) data read communication from functions in Function Set 

25 60 6 which output information to the operating technician, 
and (3) receipt of multi-process and/or multitasking 
interrupts and execution enablement data signals from 
Real-Time Executive Logic 402. Graphical Output Engine 
802 is in data reading communication with Signal I/O Logic 

30 408, Reference Data Logic 404, and Associative Value 

Engine 812 so that data from these sections is output to 
the operating technician. Graphical Input Engine 804 
interfaces the keyboard or other input device associated 
with Monitor 102 in bilateral data communication with 
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Real-Time Executive Logic 402 for execution- enablement 
data signals, multi-process and/ or multitasking 
interrupts, and data input to Function Set 606 and Mode ID 
608. Graphical Input Engine 804 is in data writing 
communication with Reference Data Logic 404, Pattern 
Recognition Logic 406, and Characterization Selection 
Routine 806 so that data is input from the operating 
technician to these logical sections as needed. Graphical 
Input Engine 804 also is in bilateral data communication 
with Learning Data Loading Engine 808 to facilitate 
operating technician activation of loading of learning 
database data and toolbox data (discussion with respect to 
Figures 13 and 14) into Signal I/O Logic 408 and Reference 
Data Logic 404. Graphical input Engine 804 optionally. 
15 contains Input Function Set 814 for enabling particular 

data sets to be defined as a group for communication in a 
unified data write operation. Characterization Selection 
Routine 806 is in data reading communication with 
Graphical Input Engine 804 and is in data writing • 
communication with Pattern Recognition Logic 406 to enable 
operating technician selection of either a Neural Network 
or Weighted Distance Classifier for use in classification. 
Learning Data Loading Engine 808 interfaces to Signal I/O 
Logic 408 for networked data or to a disk or CD-ROM (not 
shown) in Classification Computer System 110 in loading of 
•learning database data and toolbox data into Signal I/O 
Logic 408 and Reference Data Logic 404. Rework Engine 810 
is in bilateral data communication with Associative Value 
Engine 812 in evaluating memberships determined in 
Associative Value Engine 812 as part of identifying 
anomalous measured vectors and notifying Real-Time 
Executive Logic 402 as described above. Rework Engine 810 . 
also is in data writing communication with Signal I/O 
Logic 408 for flagging retention of anomalous measurements 
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to the attention of the operating technician. Associative 
Value Engine 812 is in data reading communication with 
Signal I/O Logic 408 for receiving membership values and 
determining appropriate membership value display data (for 
5 example, without limitation, basic or normalized form) . 
Associative Value Engine 812 is in bilateral data 
communication with Rework Engine 810 and is in data 
writing communication with Graphical Output Engine 802 for 
purposes previously discussed, 

10 

Figures 9A and 9B present a block flow diagram of the 
pattern recognition logic in the monitoring system. 
Pattern Recognition Logic Detail 900 presents detail in 
Pattern Recognition Logic 406. Signal I/O Logic 408, 

15 Reference Data Logic 404, Real-Time Executive Logic 402, 
and Human Interface Logic 412 are reprised from Figure 4 . 
Evolutionary Feature Selector 902 is in bilateral data 
communication with Reference Data Logic 404 for receiving 
learned data and toolbox data (Figures 13 and 14) needed 

20 in defining a set of features for use in classification. 
Evolutionary Feature Selector 902 implements random 
selection of a plurality of feature sets where each 
individual set of features is then used by Weighted 
Distance Classifier 906 or Neural Net Engine 908 in 

25 defining a classifier; the classifier is then used to 

evaluate the memberships of individual test measurements; 
the evaluations are then compared to judgments from a 
human expert to define the most acceptable sets of 
features in the plurality of feature sets. The most 

30 acceptable feature sets are then either enhanced or 

randomly cross-mutated (Figures 21A-21D) on a feature-by- 
feature basis to define a new plurality of feature sets. 
When an acceptable threshold of classification confidence 
is achieved, the feature set achieving the threshold is 

-35- 



SDOCID: <WO 019e849Ae_L> 



10 



15 



20 



25 



30 



WOOJ/98849 ^_ «^^„,^„ 

^HF PCT/USOl/17308 

then used to classify Mechanical Assembly 124. a further 
discussion of the evolutionary operation of Evolutionary 
Feature Selector 902 is presented in the discussions of 
Evolutionary Feature Selection Process 1900 of Figure 20 
and in the Example illustrated. by Figures 21A-21D. 
Evolutionary Feature Selector 902 is in bilateral data 
communication with Selected Feature Stack 910 to store 
most acceptable feature sets; Evolutionary Feature 
Selector 902 is in bilateral data communication with 
Neural Net Engine 908 and Weighted Distance Classifier 906 
for classifying feature sets and evaluating results. 
Evolutionary Feature Selector 902 is in data reading 
communication with neural network Parameter Instance 912 
and in data writing communication with NN Real-Time 
Parameters 914 for reading and storing the final selected 
set of features and classification reference parameters 
(weighting matrix and adaptation parameters) for real-time 
use. As should also be apparent. Evolutionary Feature 
Selector 902 is in bilateral data communication with Real- 
Time Executive Logic 402 for execution enablement data 
signals, multi-process and/or multitasking interrupts, and 
data input to Function Set 606. 

Progressive Feature Selector 904 is in bilateral data 
communication with Reference Data Logic 404 for receiving 
learned data and other toolbox data needed in defining a 
set of features for use in classification. Progressive 
Feature Selector 904 implements a routine of progressively 
evaluating an iteratively decreased plurality of feature 
sets where each set of features is used by Weighted 
Distance Classifier 906 or Neural Net Engine 908 in 
defining a classifier; the classifier is then used to 
evaluate the memberships of individual test measurements; 
and the evaluations are then compared to judgments from a 
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hiiman expert to define the most acceptable sets of 
features in the plurality of feature sets. The features 
of the most acceptable feature set are then enhanced with 
features not in the acceptable set to define a new 
plurality of feature sets. When an acceptable threshold 
of classification confidence is achieved, the feature set 
achieving the threshold is then used to classify 
Mechanical Assembly 124. A further discussion of the 
progressive selection operation of Progressive Feature 
Selector 904 is presented in discussion of Progressive 
Feature Selection Process 1800 of Figure 18 and in 
auxiliary detail in Figure 19. Progressive Feature 
Selector 904 is in bilateral data communication with 
Selected Feature Stack 910 to stack the most acceptable 
features during the process of evaluation; the stacking 
enables efficient use of memory in retaining the desired 
features. Progressive Feature Selector 904 is in bilateral 
data communication with Neural Net Engine 908 and Weighted 
Distance Classifier 906 for classifying feature sets and 
evaluating results. Progressive Feature Selector 904 is in 
data writing communication with Weighted Distance Real- 
Time Parameters 916 for storing the final selected set of 
features and classification reference pareimeters (decision 
function set and decision feature set) for real-time use. 
As should also be apparent. Progressive Feature Selector 
904 is in bilateral data communication with Real-Time 
Executive Logic 402 for multi-process and/or multitasking 
interrupts, execution enablement data signals, and data 
input to Function Set 606. 

Weighted Distance Classifier 906 is a weighted distance 
classifier as generally understood in the art. Examples 
of such classifiers are described in: 
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Bezdek, J.C., "Pattern Recognition with Fuzzy 
Objective Function Algorithm", Plenum Press, New 
York, 1981; 

Gath, I., "Unsupervised Optimal Fuzzy Clustering", 
IEEE Trans, Pattern Analysis and Machine Intell., 
Juli 1989; 



Jollife I.T., "Principle Conponent Analysis", 
^° Springer Verlag 1986; 

Kandal, A., "Fuzzy Techniques in Pattern 
Recognition", John Wiley, New York, 1982; 



15 



20 



25 



30 



Kittler, J., "Mathematical Methods of Feature 
Selection in Pattern Recognition", International 
Journal on Man-Machine Studies, 1975, No. 7, S. 
609-637; 

Mahalanobis, P.C, «0n the generalized distance in 
statistics", Proc. Indian Nat. Inst. Sci. 
Calcutta, 193 6, S. 49-55; 

Watanabe, s., "Karhuen-Loewe Expansion and Factor 
Analysis", Transactions 4th Prague Conference on 
Information Theory, 1965, S, 635-660; 

Zimmermann, H.J., "Fuzzy Set Theory and its 
Applications", Kluver Academic Publishers, 1991; 

(Previously referenced) Strackeljan, J., 
"Klassifikation von Schwingungssignalen mit 
Methoden der , unscharf en Mustererkennxing" , 
Dissertation TU Clausthal, 1993; and 
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5 



Strackeljan, J., Weber, R., ''Quality Control and 
Maintenance'', In: Fuzzy Handbook Prade and Dubois, 
Vol. 7 Practical Applications of Fuzzy 
Technologies, Nov. 1999, Kluwer Academic 



Publisher . 



Neural Net Engine 908 is a neural network classifier as 
generally understood in the art. An example of such a 
10 classifier is described in 



In addition to previously discussed data communications, 
Weighted Distance Classifier 906 and NN Logical Engine 908 
are in bilateral data communication with Signal I/O Logic 
25 4 08 for implementing real-time classification of 
Mechanical Assembly 124. 

NN (Neural Network) Parameter Instance 912 is in bilateral 
data communication with Neural Net Engine 908 for holding 
interim features (real-time Neural Network Feature Set 
30 934) and neural network data (Real-Time Weighting Matrix 
932) during classifier definition. NN Real-Time 
Parameters 914 provides Weighting Matrix and Adaptation 
Parameters Instance 928 and Neural Network Feature Set 93 0 



Rumelhart, D.E., McClelland, J.L. and the PDP 
Research group, "Parallel Distributed 
Processing", MIT Press, Cambridge, MA, 1986 



15 



and 



20 



Pao, Y.H., "Adaptive Pattern recognition and 
Neural Networks", Addison-Wesley Publishing 
Company, 1989. 
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to Neural Net Engine 908 for real-time evaluation of 
Mechanical Assembly 124. During adaptation to define a 
new classifier, nn Real-Time Parameters 914 continues to 
provide real-time classification of Mechanical Assembly 
124 even as Neural Network Parameter Instance 912 is used 
during the definition of a further improved parameter set 
for use with Neural Net Engine 908. Weighted Distance 
Real-Time Parameters 916 provides Decision Function Set 
924 and Decision Feature Set 926 to Weighted Distance 
Classifier 906 for real-time evaluation of Mechanical 
Assembly 124. During adaptation to define a new 
classifier. Weighted Distance Real-Time Parameters 916 
continues to provide real-time classification of 
Mechanical Assembly 124 even as Weighted Distance 
Parameter Instance 918 is used during the definition of a 
further improved parameter set for use with Weighted 
Distance Classifier 906. Weighted Distance Parameter 
Instance 918 is in bilateral data communication with 
Weighted Distance Classifier 906 for holding interim 
features (Decision Feature Set 922) and Weighted-Distance 
Classifier data (Decision Function Set 920) during 
classifier definition. 

As previously referenced. Selected Feature Stack 910 
stacks the most acceptable features during the process of 
evaluation; the stacking enables efficient use of memory 
in retaining the desired features. In this regard, the 
features of the first-evaluated feature sets are 
automatically retained in the initial feature set until 
the stack is full; thereafter, features which demonstrate 
superior classification performance supplant the lower 
performing features in the stack. 
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Stack 910 is appreciated in reference to the 
reclassification rate (predictive capability and/or error) 
concept. On the basis of a classified learning sample for 
which an unambiguous class assignment is performed prior 
to use for each random sample collected during a learning 
phase,, a measure of appraisal is obtained by reclassifying 
the learning sample with the respective classification 
algorithm and a selected subset of classifying data. The 
ratio of (a) the number of random samples correctly 
classified in accordance with the given class assignment • 
to (b) the total number of random samples investigated 
provides (c) a measure of the reclassification rate, 
error, and predictive capability of the particular 
evaluated classifier and selected classifying data; as 
should be appreciated, the goal of the process is 
ultimately to obtain a very small reclassification error. 
In the ideal case, (a) the decision on class assignment 
for reclassification agrees with (b) the class subdivision 
of the learning sample for all objects on the basis of 
the maximal alignment of the two membership determinations 
{that is, the best feature combination is the one that 
provides the very best alignment between the first 
determinations of the human expert and the subsequent 
determinations of the trained classifier respective to the 
each of the particular feature combinations tested for 
that alignment) . The advantage of the reclassification 
error concept is the possibility of determining conclusive 
values even with a small n\imber of random samples. 

Separation sharpness is also a key factor in the example. 
The classification decision gains unambiguity if the 
distance between the two largest class memberships 
increases. Based on these membership values, a sharpness 
factor is defined; the sharpness factor is considered in 
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the selection process if two or more feature combinations 
have identical classification rates. 

Stack 910 is further appreciated in the context of an 
overview of certain steps used in the method of feature 
5 selection. 



10 



15 



In Step 1, the best combinations of features from the 
totality of all available results are selected (that is 
each feature combination instance is used to train the 
classifier, classify the sample data of the learning 
database, generate a comparison between the classified 
sample and the earlier evaluation' of the human expert, and 
all of the tested feature combination instances thus 
tested are ranked to define the best predictive feature 
combinations among all of those combinations ■ evaluated) . 
For this purpose, a sorted list of all calculated measures 
of quality is prepared; from this list, a specified number 
of best feature combinations are accepted in a 'best list' 
as a basis for the further selection process. 

In step 2, the best feature combinations of Step 1 (in the 
first iteration, all feature pairs in the stack; in the 
next iteration, all feature triplets in the stack; in the 
nth iteration, all combinations of n+1 features) are 
successively combined with all features not previously 
included in the pairing of features. Features for which 
25 low measures of quality have been calculated in the 

appraisal of the feature pairs are thus re-included in the 
selection process. 

In step 3, the best feature predictor combination is 
evaluated against a measure of acceptability, and the 
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process of steps 1 and 2 is repeated until (a) one (best) 
combination with the desired predetermined number of 
features has been defined or (b) a specified Recall rate 
(ability to predict vis a vis the huiman e3<pert) is 
5 achieved. 



The following example further shows the nature and 
operation of Selected Feature Stack 910. 

Example 1 

Respective to notation, '^z" is the Object number for a 
10 particular individual having a feature set and membership 
in a class (that is when z is expressed as a n\imeric 
value, then Fz^x is considered to have a specific 
quantitative value in the example; when z is expressed as 
the textual '"z", then Fz^x is a logically identified 
15 variable representing a classifying feature in the 

example) , An Object, therefore, is a feature vector and 
affiliated class membership value as a combination. 

Beginning with a Feature set size of 2, the example shows 
20 Table 3 having 2 0 samples (10 for class 1 designated with 
z = 1,10, and 10 for class 2 designated with z = 11/20) 
after the set of features has been used to train a 
classifier and the classifier has been used to categorize 
each sample in the learning set. 



30 
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Table 3 



First Feature 
Value 


Second 
Feature 

V OlUC 


Membership Value 
Predicted from using 
trained classifier 

(note: these are examples 
of what the newly-trained 
classifier defines as a 
Membership Value set) 


Membership 
Value Measured 
from Human 
ExDert Innut 


Fl,6 


Fl,i2 


0 


0 


F2,6 


F2,12 


-z^.- ^% -"k-^ .-J- 


1 (misclassifiedy^^ 


F3,6 


F3,12 


0 


0 


F4,6 


F4,12 


0 


0 


F5.6 


F5,12 


0 


0 


F6,6 


F6,12 


0 


0 


F7,6 


F7,12 


0 


0 


F8,6 


F8,12 


0 


0 


F9.6 


F9,12 


0 


0 


Fio,6 


Fio,12 


0 


0 


Fu,6 


Fn,i2 


1 




F12.6 


Fl2,12 


1 




F13.6 


Fl3,12 


1 




Fj4.6 


F14.I2 


1 


1 


Fl5,6 


F15.I2 


1 




Fi6,6 


F16.I2 


1 




Fl7,6 


Fl7J2 


1 




F28,6 


F18.I2 


.1 




Fl9,6 


Fl9,12 


1 




F20,6 


F2O.I2 


1 





As can been seen, the Recall Rate = 1.0 - 1.0 / 20.0 = 
0.95. For each feature combination of 2 features, a 
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Recall Rate is determined. Table 4 shows the Fg^g - Fz,x2 
Recall Rate along with another F^^e - ^z,ib Recall Rate (note 
that there is no equivalent Table 3 for the Fz,e - Fz,i8 
Recall Rate determination) . 

5 Table 4 



F2.6 ^2.12 


95 percent 
correct in 
predicting. 


F^^is 


92 percent 
correct in 
predicting. 



Table 5 expands on the example of Tables 3 and 4 and adds 
the Sharpness factor to provide a Sorted list with a stack 
size of 50. 

10 Table 5 



Pos. 


First 


Second 


Recall 


Sharp- 




feature 


feature 


Rate 


ness 




value 


value 






1 


6 


12 


0.95 


0.151 


2 


6 


18 


0.92 


0.125 


3 


7 


14 


0.92 


0.108 


4 


6 


21 


0.91 


0.132 


5 


5 


11 


0.89 


0.095 


6 


4 


12 


0.89 


0.089 


7 


6 


19 


0.88 


0.086 


8 


7 


18 


0.86 


0.084 


9 


5 


34 


0.86 


0.081 


10 


5 


33 


0.85 


0.082 












48 


7 


12 


0.81 


0.071 


49 


7 


33 


0.81 


0.069 


50 


6 


19 


0.80 


0.068 
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continuing the Example, Table 6 shows a new incoming 
evaluation: 



Table 6 



First 
feature 
value 


Second 
feature 
value 


Recall 
Rate 


Sharp- 
ness 


> 8 


14 


0.90 


0.116- 



This new F,.8 - result of Table 6 pushes part of the 

Stack 910 down as shown in Table 7 to provide an updated 
list after evaluation of feature combination 8 | 14 . 



Table? 



10 



Pes. 


Feature 
Value 1 


Feature 
Value 2 


Recall 
Rate 


Sharp-ness 


1 


6 


12 


0.95 


0.151 


2 


6 


18 


0.92 


0.125 


3 


7 


14 


0.92 


0.108 


4 


6 


21 


0.91 


0.132 






r 14: 


. 0.90 


; 0,11^ 


6 


5 


11 


0.89 


0.095 


7 


4 


12 


0.89 


0.089 


8 


6 


19 


0.88 


0.086 


9 


7 


18 


0.86 


0.084 


10 


5 


34 


0.86 


0.081 












48 


6 


17 


0.82 


0.081 


49 


7 


12 


0.81 


0.071 


50 


7 


33 


0.81 


0.069 



End of Example 1 



Figure 10 presents detail in a decision function set of 
the pattern recognition logic. Decision Function Detail 
1000 shows detail in Decision Function Set 920 and 
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Decision Function Set 924. Each Class used to 
characterize a measured signal (whether used in classifier 
definition or in. real-time classification) has an 
affiliated eigenvalue set and eigenvector set. In a 
5 system of N Classes being used for classification. Class 1 
Eignenvector Set 1002 , Class N Eigenvector Set 1004, 
Class 1 Eigenvalue Set 1006, and Class N Eigenvalue Set 
1008 are each retained as shown within Decision Function 
Set 920 and (for the real-time case) in Decision Feature 
10 Set 926, 

Figure 11 presents a block flow diagram of the signal and 
data I/O and logging logic in the monitoring system. 
Signal Logic Detail 1100 therefore presents detail in 
Signal I/O Logic 408. Pattern Recognition Logic 406, 

15 Reference Data Logic 404, Real-Time Executive Logic 402, 
Signal Conditioning Logic 410, and Human Interface Logic 
412 are reprised from Figure 4. Feature Derivation Engine 
1102 derives features from input signals Analog Input 
Signal 118 and/or Digital Input Signal 116 in the context 

20 of attributes of Tool-Specific Feature Functions 1104 

(discussed in further detail in Derivation Functions 12 00 
of Figure 12) . Feature Derivation Engine 1102 is in 
bilateral data communication with Real-Time Signal Input 
Engine 1108 in achieving several key functionalities: (1) 

25 data reading communication of measurements respective to 
Analog Input Signal 118 and Digital Input Signal 116, (2) 
acquiring data from Reference Data Logic 404, (3) 
occasionally acquiring updated Tool-Specific Feature 
Functions 1104 routines from Human Interface Logic 412, 

30 and (4) data writing communication of derived features and 
feature values to Real-Time Signal Input Engine 1108 for 
further communication to Pattern Recognition Logic 406. 
Log of Learning Measurements 1106 is in data writing 

-47- 



SDOCIO: <WO 0198848A^.I.> 



wo 01/98849 _ — PCT/USOl/17308 



coiratiunication with Real-Time Signal Input Engine 1108 for 
receiving and holding measurements respective to anomalous 
measured vectors when Real-Time Signal Input Engine 1108 
is prompted by Rework Engine 810. Log of Learning 
Measurements 1106 also is in bilateral data communication 
with Human Interface Logic 412 and Network Interface 1116 
for further communication or copying of Log of Learning 
Measurements 1106 data to an operating technician, a 
floppy, a CD-ROM, or other system. Real-Time Signal Input 
Engine 1108 is in bilateral data communication with Human 
Interface Logic 412 for sending classification results and 
for receiving updated Tool-Specific Feature Functions 1104 
routines, for receiving configuration data for hardware 
signals (for storage in Signal Configuration Schema 1110), 
and for receiving a flag respective to an anomalous 
measured vector. Real-Time Signal Input Engine 1108 is in 
bilateral data communication with Feature Derivation 
Engine 1102 as previously described. Real-Time Signal 
input Engine 1108 is in bilateral data communication with 
Pattern Recognition Logic 406 for sending derived feature 
values and feature data to Pattern Recognition Logic 406 
and for receiving classification feedback respective to 
feature values and feature data. Real-Time Signal Input 
Engine 1108 is in bilateral data communication with 
Reference Data Logic 404 for informing Reference Data 
Logic 404 of the particular signal being read and 
responsively acquiring feature data to classify the 
signal. Real-Time Signal Input Engine 1108 is in 
bilateral data communication with Real-Time Executive 
Logic 402 for (a) receiving execution enablement data 
signals, multi-process and/or multitasking interrupts, and 
(b) sending feedback and flagging inputs so that 
responsive logic is executed in a unified and coordinated 
real-time cadence. Real-Time Signal Input Engine 1108 is 
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in bilateral data communication with Network Interface 
1116 for receiving certain measured signal data directly 
from Network 146 and for interacting with certain external 
systems via Network 146 as needed. Real-Time Signal Input 
Engine 1108 is in bilateral data communication with 
Process Information System Interface 1112 for interfacing 
with Process Information System 104; in Signal Logic 
Detail 1100 of Figure 11, Process Info2rmation System 
Interface 1112 is shown using Network Interface 1116 to 
interface to Process Information System 104, but the 
interface can also be via another data communication means 
such as a direct serial link. PI Buffer 1114 is used for 
holding data exchanged between Process Information System 
104 and Classification Computer System 110 during 
transfers . 

Figure 12 presents detail in tool-specific feature 
derivation functions. Derivation Functions 1200 shows 
further detail in the particular fiinctions used to derive 
features used in classification of Mechanical Assembly 
20 124. Each Feature Function contains the logical routine 
used to derive the features. For any particular signal, 
as indicated in the discussion of Reference Data Detail 
1300 in Figure 13, a function (Aligned Function 1326) and 
set of attributes (Related Functional Attribute 1328) is 
25 defined for at least one feature; this data is referenced 
by Feature Derivation Engine 1102 and which applies the 
appropriate function in Tool-Specific Feature Functions 
1104 to derive the feature values for use in .Pattern 
Recognition Logic 406. 



10 



30 FFT Feature Function 1202 is generally understood in the 
art. This function is described in (1) Brigham, E.O., 
''The Fast Fourier Transform", Prentice-Hall Inc., 1974 
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and also in (2) Cooley, J.w. and Tukey, J.w., "An 
Algorithm for the Machine Calculation of Complex Fourier 
Series", Mathematical Computation 19, 1965. 



RPM Feature Function 1204, Minimum Signal Value Feature 
Function 1206, Maximxim Signal Value Feature Function 1208, 
and RMS Feature Function 1210 are generally understood in 
the art. These fxinctions are described in 



Bannister, R.H., »A review of rolling element 
bearing monotoring techniques". Fluid Machinery 
Committee, Power Industries, London, Jxine 1985; 

Callacott, R.A., "Mechanical Fault Diagnosis and 
condition Monitoring", Chapman and Hall, London, 
1977; 



Hunt, T.M, "Condition Monitoring of Mechanical 
Equipment and Hydraulic plant". Chapman and 
Hall, 1996; 



Rao, B.K.N. , "Handbook of condition monitoring", 
Elsevier Advanced Technologies, 1996; 

Harris, T.A., ^'Rolling Element bearing 
Analysis", Third Edition, New Vork, 1991, John 
Wiley & Sons, Inc.; 

Berry, J.E., "How to Track Rolling Element 
Bearing Health with Vibration Signature 
Analysis", Sound and Vibration, 25(1991) 11, pp. 
24-35; 
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Dyer, D. and Stewart, R,M., ''Detection of 
Rolling Element Bearing Damage by Statistical 



Vibration Analysis", Journal of Mechan^ical 
Design, Vol. 100, 1978, pp. 229-235.; and 



5 



Edgar, G.R. and Gore, D.A. , ''Techniques for the 
Early Detection of Rolling Bearing Failures", 
SAE Technical Paper Series, 1984, pp. 1-8. 



Curtosis Feature Function 1212 is generally understood in 
the art. This function is described in Rush, A.A. , 
10 "Kurtosis a crystal ball for maintenance engineers". Iron 
and Steel International, 52, 1979, S. 23- 27. Filtered 
Curtosis Feature Function 1214 is achieved by time- 
filtering a Curtosis value. 

Envelope Set Feature Function 1216 is generally understood 
15 in the art. This function is described in Jones, R.M. , 
"Enveloping for bearing Analysis", Sound and Vibration, 
30(2) 1996, page 10. 

Cepstrum Feature Function 1218 is generally understood in 
.the art. This function is described in Randall, R.B., 
20 "Cepstrum Analysis and Gearbox Fault Diagnosis", Brtiel and 
Kjaer application note No. 233. 

CREST Feature Function 1220 is generally understood in the 
art. This function is described in Bannister, R.H. , "A 
review of rolling element bearing monitoring techniques", 
25 Fluid Machinery Committee, Power Industries, London, Jxme 
1985. 
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Filtered CREST Feature Function 1222 is generally 
understood in the art. This function is described in (1) 
Dyer, D. and Stewart, R.M. , "Detection of Rolling Element 
Bearing Damage by Statistical Vibration Analysis", Journal 
of Mechanical Design, Vol. 100, 1978, pp. 229-235; and (2) 
Bannister, R.H., «A review of rolling element bearing 
monitoring techniques". Fluid Machinery Committee, Power 
Industries, London, June 1985.. 



Dimensionless Peak Amplitude Feature Function 1224 is 
derived from a time signal as a dimensionless parameter. 
The mean peak height of the time signal characterizes the 
degree of peak plurality and peak impulse magnitude, and 
the periodicity and constancy between a peak and two 
following peaks. To derive the dimensionless parameter of 
Dimensionless Peak Amplitude Feature Function 1224, the 
ratio between the mean amplitude and the signal «base" is 
first established. 



Equation 1 



Base level: 

'=]i72«*'^(^y)with M samples of the time signal 

M = Number of data points 
X = digital data samples 
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Equation 2 

Average peak amplitude 

N = Number of detected peaks in time signal 

5 apj = Amplitude of peak j 

The Feature of Dimensionless Peak Amplitude Feature 
Function 1224 is then 

Equation 3 

Dimensionless Peak Separation Feature Function 1226 is 
derived from a time signal as a dimensionless parameter. 
An ideal roller bearing damage consistently generates 
peaks in the time signal from the sensor monitoring the 
bearing- The constancy of generated peaks (as related to 
the distances between the peaks) is expressed by 
calculating all distances between a set of peaks and 
building the variance to a mean value. A roller bearing 
in good condition reflects a high degree of variance 
through small, stochastically distributed signal peaks. 
To ensure the comparability of different rotation speeds, 
a dimensionless ratio is established by dividing the 
variance by the mean distance between peaks. 
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Equation 4 



Average peak distance 



2 N-l 



N = Number of detected peaks in time signal 
dpj = Distance between peak j and peak j-1 



Equation 5 



The feature of Dimensionless Peak Separation Feature 
10 Function 1226 is then calculated from 

Equation 6 



f2 



_ "-UP 



Figure 13 presents a block flow diagram of the reference 
data logic in the monitoring system. Reference Data 
Detail 1300 shows detail in Reference Data Logic 404. 
Pattern Recognition Logic 406, Signal I/O Logic 408, Real- 
Time Executive Logic 402, and Human Interface Logic 412 
are reprised from Figure 4. For any particular signal, as 
indicated in the discussion of Figure 12, a function 
(Aligned Function 1326) and set of attributes (Related 
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Functional Attribute 1328) is defined for at least one 
feature; this data is referenced by Feature Derivation 
Engine 1102, which applies the appropriate function in 
Tool-Specific Feature Functions 1104 to derive feature 
5 values for use in Pattern Recognition Logic 406. Learning 
Database 13 02 shows a set of records related to a 
particular Tool ID 1334. For each Tool ID 1334 there is a 
set of features. Feature 1 (Fl) 1318 through Feature N 
(Fn) 132 0 for which a judgment (from a human expert) is 

10 also expressed as a value in Judgment Value 1322 data- 
field. A set of rows of values showing Feature 1 1318 
through Feature N 13 2 0 values and a judgment as a class of 
operational status is provided for each Tool ID 1334. In 
the context of the aligning provided by the design of 

15 Candidate Feature Database 1304 and Tools Database 1306 
and Component Database 1308, Learning Database 1302 
therefore represents the collected input of human 
professional understanding (respective to interpretation 
of the status of Mechanical Assembly 124 in operation) to 

20 Classification Computer System 110 sp that Classification 
Computer System 110 provides rapid mechanized access in 
real-time to that collected understanding. A further 
discussion of how Feature N 1320 data is assembled is 
described in the discussion respective to Toolbox 

25 Development Overview 23 00 in Figure 25. Further 

considerations in (1) selecting a proper number of classes 
(providing an inherent class structure) for articulating 
judgment and (2) defining acceptable predictability of a 
classifier instance is discussed in Component Assembly 

30 2200 and Toolbox Development Overview 2300 of Figures 24 
and 25. Candidate Feature Database 13 04 is a table of a 
set of Features 1324 and a Related Tool Identifier 1330 
data- field showing the particular Tool ID 1334 set for 
which that Feature 1324 is relevant. In this regard, a 
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particular Feature 1324 is any one feature in the set of 
features (Feature 1 1318 through Feature N 1320) in 
Learning Database 1302 where one Feature N 1320 record is 
related to one Tool ID 1334. Aligned Function 1326 
5 logical identifier is also provided along with Related 
Functional Attribute 1328 so that Feature Derivation 
Engine 1102 executes the proper function of Tool-Specific 
Feature Functions 1104 and also determines the appropriate 
attribute of the derived function in derivation of a 
10 particular feature value. Tools Database 1306 is a table 
of values respective to the variable types Input Channel 
Logical ID 1332, Tool ID 1334, and Tool Identifying Term 
133 6 (for facilitating human interaction with Reference 
Data Detail 1300 by providing a lexical string identifier 
15 for display on Monitor 102). input Channel Logical ID 

1332 is dependent upon a particular Filter Circuit 3 00 on 
Band-Pass-Filter Circuitry Board 204; the purpose of 
input Channel Logical ID 1332 is to enable crosscheck in 
execution of Hardware Configuration Function 702 so that 
20 an operating technician attaches an instance of Analog 
Input Signal 118 to the proper Signal Wire Terminators 
212. component Database 1308 provides a further reference 
so that instances of Component Identifier 1338 (see the 
further discussion of Component Assembly 2200 in Figure 
25 24) are, when combined with a particular Sensor Type 1340, 
wired to the proper Input Channel Logical ID Field 1342. 
Note that, in using Component Database 1308 and Tools 
Database 1306, a Component Identifier 1338 in combination 
with a Sensor Type 1340 "points" to acceptable Input 
30 Channel Logical ID Field 1342 values. The Input Channel 
Logical ID Field 1342 values (which could be more than one 
relative Signal Wire Terminator 212), when mapped to the 
table of Tools Database 13 06, enable identification of a 
particular Input Channel Logical ID 1332; ID 1332 then 
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identifies an appropriate Tool ID. 1334 in alignment with 
Component Identifier 133 8, Sensor Type 1340, and Input 
Channel Logical ID 1332 (resolving hardware alignment 
considerations in the classifier) . Tool ID 133 4 then 
5 references a set of Feature 1324 instances in Candidate 
Feature Database 1304 (a datalogical reference for 
evaluation of Component Identifier 133 8 in operation) and 
also references a particular record of Learning Database 
13 02 (collected human learning in intersection with the 

10 set of Feature 13 24 instances in the datalogical reference 
frame of Candidate Feature Database 13 04) . The set of 
Features 1324 with their particular Learning Database 13 02 
instance is then used in conjunction with (a) Progressive 
Feature Selector 904 (or, alternatively. Evolutionary 

15 Feature Selector 902) and (b) with Weighted Distance 

Classifier 906 (or, alternatively. Neural Net Engine 908) 
to derive a subset, for each Judgment Value 13 22 class, of 
(c) Feature 1 1318 - Feature N 1320 features for use in 
real-time classification. Real-Time Signal Feature Set 

20 Instance 1310 is the subset, for each Judgment Value 1322 
class, of (c) Feature 1 1318 - Feature N 1320 features for 
use in real-time classification for a particular Analog 
Input Signal 118 (Digital Input Signal 116 or Analog Input 
Signal 118 /Digital Input Signal 116 combination) instance 

25 respective to at least one identified judgment class 

(Judgment Value 1322 type) . Real-Time Signal Feature Set 
Instance 1310 points to a particular Decision Function Set 
924 instance and aligns with a respective Decision Feature 
Set 926. Real-Time Signal Feature Set Instance 1310 is 

30 accessed by Signal I/O Logic 408 in interactions with 
Feature Derivation Engine 1102 and Pattern Recognition 
Logic 406. Feature Data Evaluation Engine 1312 (in data 
reading communication with Learning Database 1302, 
Candidate Feature Database 1304, Tools Database 1306, and 
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10 



15 



20 



25 



30 



Component Database 1308) is used with Feature Selection 
Function 714 and Classifier Definition Fxmction 718 in 
defining a classifier instance. Configuration Tables 
Interface 1314 is in bilateral data coinmxmication with 
Learning Database 13 02, Candidate Feature Database 1304, 
Tools Database 1306, Component Database 1308, and Real- 
Time Signal Feature Set Instance 1310 for loading these 
tables and providing the operating technician with a full 
reference frame for evaluating the status of the data 
which is custom to a particular instance of Mechanical 
Assembly 124 (note that Configuration Tables Interface 
1314 is in bilateral data communication with Human 
Interface Logic 412 and Real-Time Executive Logic 402) . 
Threshold Value 1316 is used by Feature Data Evaluation 
Engine 1312 in a decision to use Evolutionary Feature 
Selector 902 in preference to Weighted Distance Classifier 
906. Depending on the capability of the particular 
Classification Computer CPU 138 and affiliated computing 
resources, the use of Evolutionary Feature Selector 902 is 
preferable for feature sets above Threshold Value 1316. 

Figure 14 presents details for a machine analysis toolbox. 
Toolbox 1400 shows Machine Analysis Toolbox 1402. in this 
regard, in one embodiment, a data schema section is 
provided with Learning Database 13 02, Candidate Feature 
Database 13 04, Tools Database 1306, and Tool-Specific 
Feature Functions 1104 as an aligned set with a unifying 
logical identified data value in Data Feature Tool Object 
1404. Machine Analysis Toolbox 1402 is, in one 
embodiment, unified in one data schema logical section, 
or, in the embodiment shown in Signal Logic Detail 1100 
and Reference Data Detail 1300, virtually provided in more 
than one logical section. Attributes Al and A3 shown in 
column 1328 (Figure 13) are the feature attributes of the 
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signal vector as derived from feature function 132 6 to 
become classification feature 1324 (as noted earlier. 
Features frequently reference a variable possessing a 
joining consideration or datalogical nexus between, first, 
5 an attribute derived in the context of a function from the 
measured signal and, second, a variable used in a 
classifier) . Machine Analysis Toolbox 1402 is, in one 
embodiment, resident as a logical object set in data form 
on a unified physical storage device such as a CD-ROM, a 

10 "floppy", or other like media. In this regard, (1) 

hardware alignment considerations, (2) the datalogical 
reference for evaluation of components in operation, (3) 
the related collected human learning in intersection with 
the datalogical reference frame, and (4) the functions 

15 needed to derive the data needed for the datalogical 

reference frame all continuously improve with time; these 
elements in the embodiment are beneficially upgraded 
periodically in Classification Computer System 110 in a 
unified manner to provide access to improved methodology. 

20 Machine Analysis Toolbox 1402, therefore, is manifested 

virtually in all embodiments and is manifested in unified 
logical form in some embodiments and in separated logical 
form in other embodiments • 

Figure 15 presents an overview flowchart of the 
25 organization of key information in constructing and using 
the preferred embodiments. Use Process Overview 1500 
outlines a broad process perspective in use of the 
classifier. In Setup Step 1502, a computer- implemented 
routines set is provided, with each routine deriving a 
3 0 feature value set from a signal generated by a type of 

sensor when used on a machine component type. In Testing 
Step 1504, a set of input signals is collected from each 
sensor type representative of a machine component in 
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different classified modes (classes) of operation (for 
example, without limitation, a Shutdown Class, a Good 
Class, a Transition Class, and a Bad Class) . m Feature 
Definition Step 1506, the computer- implemented routines 
are applied to derive a feature value set for each 
measured input signal instance, and each feature value set 
is added to a Learning Database. In Expert Input Step 
1508, a class affiliation parameter value (judgment) is 
associated with each input signal instance in the Learning 
Database. In this regard, the "classified modes" of 
operation of Testing Step 1504 are based on human 
understanding; in Expert Input Step 1508, this 
understanding is datalogically expressed and affiliated 
with each signal for which a feature value set was derived 
in Feature Definition Step 1506. In Toolbox Assembly Step 
1510, the information of Testing Step 1504, Feature 
Definition Step 1506, and Expert Input Step 1508 is 
organized in the context of the data reference of the 
routines of Setup Step 1502. In this regard, the (a) set 
of sensor identifiers, (b) feature routines related to 
each sensor type, (c) sets of features defined by the 
feature routines, (d) learning databases, and (e) 
affiliated query and configuration routines and data are 
all collected into a Toolbox Of Data Feature Tools 1402 
for use in computer memory. m Use Step 1512, the Toolbox 
1402 is used in configuration and real-time operation of 
the monitoring system to measure the status of a unified 
component assembly (Mechanical Assembly 124) in operation. 

Figure 16 presents a flowchart of key classification 
steps. Implementation Process Overview 1600 shows further 
detail in Use Step 1512. m Configuration Step 1602, 
configuration of Reference Data Logic 404 customizes' 
Classification Computer System 110 to a particular 
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instance of Mechanical Assembly 124 by (a) identifying 
deployed sensors (see Component Assembly 2200 of Figure 
22) ; (b) assigning a channel (Signal Wire Terminators 
212) , component /sensor (Component Identifier 1338 8c Sensor 
5 Type 1340), and/or Toolbox Tool ID (Related Tool 
Identifier 1330) to each sensor; and (c) providing 
historical learning data to Learning Database 1302. 

In Optional Learning Step 1604, an optional learning phase 
is implemented to acquire further 'measurements in the 
learning base. This is an optional step in the sense that 
such learning is alternatively acquired in the course of 
adaptation (Adaptation Step 1610) ; however, in certain 
applications, it is beneficial to perform system testing 
prior to full commitment to use so that Learning Database 
1302 reflects both (a) measurements and judgments for the 
type of component and sensor in prior use on other 
embodiments of Mechanical Asseiably 124 or from a test 
environment and (b) specifically judged measurements for 
the particular Mechanical Assembly 124 being monitored by 
the instance of Classification Computer System 110 
configured. 

In Classifier Derivation Step 1606, a real-time classifier 
reference parameter instance (Weighted Distance Real-Time 
Parameters 916 or NN Real-Time Parameters 914) is derived 
25 for each component and sensor combination. In Real-Time 
Classifying Step 1608, derivation and depiction of real- 
time membership values, (the membership of each component 
in each class valid for that component) is performed in an 
ongoing manner. In Adaptation Step 1610, adaptation of 
30 Learning Database 1302 and redefinition of Weighted 
Distance Real-Time Parameters 916 (or NN Real-Time 
Parameters 914) is executed (via multi-process and/or 
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multitasking interrupts and execution enablement data 
signals from Executive Logic 402) along with on-going 
derivation and depiction of real-time membership values, 
in Anomalous Vector ID Step 1612, anomalous vectors are 
5 identified (Rework Engine 810) . In Human Query Step 1614, 
Monitor 102 is queried for operating technician input 
' respective to judgment for the anomalous Vector. In 
Adaptation Decision 1616, the operating technician inputs 
a decision to proceed to redefine Weighted Distance Real- 
10 Time Parameters 916 (or NN Real-Time Parameters 914) . if 
the decision result is NO, Adaptation Decision 1616 
terminates to Exit Step 1620. If the decision result is 
YES, Adaptation Decision 1616 terminates to Replacement . 
Classifier Derivation Step 1618. In Replacement 
15 Classifier Derivation Step 1618, a new real-time 

classifier reference parameter instance is determined via 
coordination of Adaptation Function 722 in Control Block 
604. Weighted Distance Parameter Instance 916 (or Neural 
Network Parameter Instance 912) provide storage for the 
20 redefinition of Weighted Distance Real-Time Parameters 916 
(NN Real-Time Parameters 914) so that the existing 
instances of Weighted Distance Real-Time Parameters 916 
(NN Real-Time Parameters 914) are used for real-time 
classification of Mechanical Assembly 124 during the 
25 adaptation process. In the final portion of Replacement 
Classifier Derivation Step 1618, the new version of 
Weighted Distance Parameter Instance 916 (NN Parameter 
Instance 912) replaces the old version for the particular 
signal for which the adaptation is being executed. In 
Exit Step 1620, the adaptation process concludes with an 
exit. 

Figure 17 presents a flowchart detailing decisions in use 
of progressive feature selection, evolutionary feature 
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selection, neural network classification, and weighted 
distance classification. Classification Overview 1700 
further defines Classifier Derivation Step 1606 to show 
the process by which each measurement vector (derived from 
5 Analog Input Signal 118, Digital Input Signal 116, or a 
combination of Digital Input Signal 116 and Analog Input 
Signal 118 signals) is classified. In Sample Signal 
Preparation Step 1702, the signal sample values are 
normalized for use in classification. This step is not 

10 executed in every contemplated embodiment, but is 
generally a preferable approach. In this regard, 
''normalized sample signals" reference the normalized 
features as a whole for a particular set of learning 
samples taken collectively and resident for a particular 

15 Tool ID 1334 in Learning Database 13 02. In Branch Step 
1704, reference rules branch the method to a particular 
combination of (a) classifier and (b) feature selection 
process. This branching is further described respective 
to considerations outlined in Table 8. 



25 



30 



35 
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Table 8 



Situation 


NN 


Evolutionary 
Feature 
Selection 


Weighted 
Distance 
Classifier 


Progressive 
Feature Selection 


Problems with a 
small number of 
possible input 
features (< 400) 


X 


X 


X 


X 


Problems with a 
large number of 
possible input 
features (> 400) 


X 


X 


X 




Learning data set 
has more then one 
disjunct cluster 
with equal class 
membership 


X 


X 




X 


oLiv/iig CilipsolQai 

distribution for the 

data set 




X 


X 


X 


High level of 
deterministic 
solutions (safety 
relevance issues, 
minimum of 
control parameters) 






X 


X 



10 



15 



in PF-WD Preparation Step 1706, a set of normalized sample 
signals is prepared for the progressive feature selection 
process. in PF-WD Class Separation Step 1708, the 
normalized sample signal set is separated into class 
subsets. in PF-WD Feature Set Definition Step 1710, the 
weighted distance classifier and the progressive feature 
selection process converge Learning Database 13 02 data for 
the particular sample signals to a real-time feature 
subset. In PF-WD Real-Time Set Storage Step 1712, the 
real-time feature subset is saved in Weighted Distance 
Real-Time Parameters 916. 
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In PF-NN Preparation Step 1714, a set of normalized sample 
signals is prepared for the progressive feature selection 
process. In PF-NN Class Separation Step 1716, the 
5 normalized sample signal set is separated into class 

subsets. In PF-NN Feature Set Definition Step 1718, the 
neural network classifier and the progressive feature 
selection process converge Learning Database 13 02 data for 
the particular sample signals to a real-time feature 
10 subset. In PF-NN Real-Time Set Storage Step 172 0, the 
real-time feature subset is saved in NN Real-Time 
Parameters 9 14 . 

In EF-NN Preparation Step 1722, a set of normalized sample 
15 signals is prepared for the evolutionary feature selection 
process. In EF-NN Class Separation Step 1724, the 
normalized sample signal set is separated into class 
subsets. In EF-NN Feature Set Definition Step 172 6, the 
neural network classifier and the evolutionary feature 
20 selection process converge Learning Database 13 02 data for 
the particular sample signals to a real-time feature 
subset. In EF-NN Real-Time Set Storage Step 1728, the 
real-time feature subset is saved in NN Real-Time 
Parameters 914. 

25 

In EF-WD Preparation Step 173 0, a set of normalized sample 
signals is prepared for the evolutionary feature selection 
process. In EF-WD Class Separation Step 1732, the 
normalized sample signal set is separated into class 
30 ' subsets. In EF-WD Feature Set Definition Step 1734, the 
weighted distance classifier and evolutionary feature 
selection process converge Learning Database 13 02 data for 
the particular sample signals to a real-time feature 
subset. In EF-WD Real-Time Set Storage Step 1736, the 
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real-time feature subset is saved in Weighted Distance 
Real-Time Parameters 916. 

Figure 18 presents detail in the weighted distance method 
of classifying and progressive feature selection. 
Progressive Feature Selection Process 1800 provides an 
overview of the method executed by Progressive Feature 
Selector 904. The set of features Feature 1 1318 to 
Feature N 1320 for a particular Tool Identifying Term 1336 
is processed to define the best subset for use in real- 
time classification. In this regard, the size of the 
subset is dependent upon the particular Classification 
computer CPU 13 8 and affiliated resources, the frequency 
at which real-time membership determinations are desired, 
15 the instances of Tool Identifying Term 133 6 in 
Classification Computer System 110, and like 
considerations. in Weighted-Distance Classifier Initial 
Features Step 1802, the features are individually .. 
evaluated if more than 400 features are defined for a 
20 particular signal. if less than 400 features are defined, 
each feature couplet is evaluated. In Weighted-Distance ' 
Classifier Initial Feature Ranking Step 1804, fitness for 
a classifier respective to each feature or feature couplet 
is evaluated. In Weighted-Distance Classifier Feature 
Selecting Step 1806, the best performing features or 
feature couplets are selected to Selected Feature Stack 
910. On subsequent iterations, the best feature sets are 
selected to Selected Feature Stack 910. In Weighted- " 
Distance Classifier Feature Set Augmentation Step 1808, 
the feature sets in the stack are separately augmented' 
with each individual feature not in the set. m Weighted- 
Distance Classifier Feature Set Fitness Decision 1810, 
each new feature set is evaluated for classification ' 
prediction fitness. if sufficient fitness prediction is 
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not achieved by any feature set ('"NO" decision result), 
then the process returns to Weighted-Distance Classifier 
Feature Selecting Step 1806. If the decision result is 
YES, Weighted-Distance Classifier Feature Set Fitness 
5 Decision 1810 terminates to WD Feature Set Acceptance Step 
1812. In Weighted-Distance Classifier Feature Set 
Acceptance Step 1812, the feature set achieving the best 
fitness is written into Weighted Distance Real-Time 
Parameters 916 (NN Real-Time Parameters 914) . Figure 19 
10 shows further detail in Steps 1804, 1806, and 1808 in 

feature evaluation detail 2900. An example of the above 
process follows. 

Example 2 

15 

Control parameters for the selection strategy are similar 
to Example 1 used to describe Stack 910 in the discussion 
of Figure 9. First, in reference (1) to the 
reclassification rate (predictive capability and/or error) 

20 concept and (2) to the basis of a classified learning 
sample for which an unambiguous class assignment is 
performed prior to use for each random sample collected 
during a learning phase, a measure of appraisal is 
obtained by reclassifying the learning sample with the 

25 respective classification algorithm and a selected subset 
of classifying data. The ratio of (a) the number of 
random samples correctly classified in accordance with the 
given class assignment to (b) the total nvimber of random 
samples investigated provides a measure of the 

30 reclassification rate, error, and predictive capability of 
the particular evaluated classifier and selected 
classifying data; as should be appreciated, the goal of 
the process is ultimately to obtain a very small 
reclassification error. In the ideal case, the decision on 
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Class assignment for reclassification agrees with the 
class subdivision of the learning sample for all objects 
on the basis of the maximal membership. The advantage of 
the reclassification error concept is the possibility of • 
determining conclusive values even with a small number of 
random samples. 

Separation sharpness is also a key factor in the example. 
The classification decision gains unambiguity if the 
distance between the two largest class memberships 
increases . Based on these membership values a sharpness 
factor is defined, which is considered in the selection 
process if two or more feature combinations have identical 
classification rates. 

Respective to notation, «z" is the Object number for a 
particular individual having a feature set and membership 
in a class (that is when z is expressed as a numeric 
value, then Fz,^ is considered to have a specific 
quantitative value in the example; when z is expressed as 
the textual «z", then F,,, is a logically identified 
variable representing a classifying feature in the 
example) . An Object, therefore, is a feature vector and 
affiliated class membership value as a combination. 

in this example, the feature "gene pool" has a Maximum Set 

Size of F2,i Fz,io and the progressive search algorithm 

determines a sub-optimal feature subset containing 3 
features . 

Human expert membership value «0" indicates that the 
sample belongs to class A, and a value «1" indicates that 
the sample belongs to class B. The human expert's decision 
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is available for all samples of the learning data base (in 
this example, a sample size of 20) . 

In Step 1 of the example, all samples from the learning 
5 database are read into the progressive selection method. 

In Step 2 of the example, the search algorithm starts with 
an opening minimum set of 2 features Fz,x - Fz,y for each 
individual (see notational paragraph above respective to 
10 variable "z") . All possible combinations of two features 
are then defined. Table 9 shows all combinations of 2 
features containing Feature "1" and the possible feature 
pairs. The combination F^.i and Fz,2 is defined using the 
notational form "1 | 2". 



15 Table 9 : 

1 
1 
1 
1 
1 
1 
1 
1 
1 



20 



25 



2 
3 
4 
5 
6 
7 
8 
9 

10 



Fx,! 
Fz,i 

Fz.l 
Fz,i 

Fz.l 



Fz,2 
Fz,3 

F2,4 

Fz.s 

Fz,6 
Fz,7 
Fa, 8 
Fz,9 
Fa. 10 



In Table 10 all possible combinations of any two features 
are listed. 



30 
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10 



15 



20 



Table 10 




















1. 


1 1 


( 


2, 


3, 


4, 


5, 


6, 


7, 


8, 


9, 10) 


2 . 


2 1 


( 


3, 


4, 


5, 


6, 


7, 


8, 


9, 


10) 


3 . 


3 1 


( 


4, 


5, 


6, 


7, 


8, 


9, 


10) 




4. 


4 i 


( 


5, 


6, 


7, 


8, 


9, 


10) 






5 . 


5 1 


( 


6, 


7, 


8, 


9, 


10) 








6. 


6 i 


( 


7, 


8, 


9, 


10) 










7 . 


7 1 


( 


8, 


9, 


10) 












8. 


8 1 


( 


9, 


10) 














9. 


'9 1 


(10) 

















The performance of each feature combination is determined 
by (1) training the Weighted Distance Classifier, (2) 
calculating the classification results for all samples of 
the learning data set, and (3) comparing the results of 
the calculation with the initial human expert 
determination (that is, establishing the comparison of 
respective ability of the trained classifier to return, 
respective to a particular « trial" feature combination, 
the same determination of membership as the human expert 
for a particular measurement) . 

25 Table 11 demonstrates this process for the feature 

combination 6 | 10 after the performance of each feature 
combination has been determined. 
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Table 1 1 : Classification results for the whole learning data set. 



First 

Feature 

Value 


Second 
Feature 
Value 


Membership 
value for class 
1 predicted 
from using 
trained 
classifier 


Membership 
value for 
class 2 
predicted 
from using 
trained 
classifier 


Class 

Membership 
Value 
calculated 
from both 
class 

membership 
values 


Membership 
Value 

Measured from 
Human Expert 
Input 


Fl.6 


Fkio 


0.8 


0.2 


0 


0 


F2.6 


F2,10 


0.4 


0.6 


1 


(!niisbias^ified) 


F3,6 


Fsao 


0.9 


0.1 


0 


0 


F4.6 


F4J0 


0,6 


0.4 


0 


0 


F5.6 


Fsjo 


0.7 


0.3 


0 


0 


F6.6 


Feao 


0.9 


0.1 


0 


0 


F7.6 


Fvao 


1.0 


0.0 


0 


0 


Fg.e 


Fsjo 


0.6 


0.4 


0 


0 


F9,6 


F9.10 


0.6 


0.4 


0 


0 


F10.6 


Fio,io 


0.7 


0.3 


0 


0 


F1K6 


Fn.io 


0.1 


0.9 


1 


1 


Fl2,6 


Fizio 


0.2 


0.8 


1 


1 


Fi3,6 


F13.10 


0.1 


0.9 






Fi4,6 


Fujo 


0.2 


0.8 






F15.6 


F15.10 


0.4 


1 0.6 






F16.6 


F16.10 


0.3 


0.7 






Fl7,6 


F17.10 


0.1 


0.9 






Fi8,6 


Fl8,10 


0.2 


0.8 






Fi9,6 


Fl9,10 


0.3 


0.7 






F20,6 


F20,10 


0.2 


0.8 







Two performance indicators are calculated from table 11 : 
5 (a) the Recall Rate for all samples: = Nijmber correct 
classified / total sample size = 19 / 20 = 0.95; and (b) 
the Sharpness as the difference between the class 
memberships . In the instance that a sample is 
misclassif ied, the difference between the membership 
10 values is 0. (If more than 2 classes are defined the 
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Sharpness is calculated as the difference between the two 
highest membership values.) 



Sharpness = (0.8-0.2) +0.0+ (0.9-0.1) + 
(0.7-0.3) + (0.9 - 0.1) + .... + (0.8-0.2) / 20.0 = 0.52 



. + 



5 Table 12 gives the result of the evaluation of the 
combination of features F^.g and F^,xo. 



Table 12 



Fz.6 Fzjo 


95 percent 




correct in 




predicting. 



10 



15 



20 



Insofar as the objective is (a) to generate a list of the 
best m feature combinations rather than (b) to store all 
evaluated feature combinations, a sorted list (Stack 910) 
with a specified stack size is updated after the 
performance check of the combination regarding Table 10 as 
previously described. 

The stack in Table 13 represents the situation after the 
evaluation of all combinations inclusive of the feature 
combination F,,8 and F,,9. The features are sorted according 
to (a) the Recall Rate and then (b) for several 
combinations according to their Sharpness where the Recall 
Rate is identical. 



25 
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Table 13: Sorted list with a stack size of 10 



Pos. 


First 


www 4 lU 


Recall 


Sharp- 




feature 


feature 

X WC*1> WX^y 


Rate 


ness 




value 


value 






1 


6 


10 


0.95 


0.52 


2 


6 


7 


0.95 


0.48 


3 


4 


9 


0.90 


0.45 


4 


7 


10 


0.90 


0.42 


5 


6 


9 


0.85 


0.43 


6 


5 


7 


0.85 


0.40 


7 


7 


8 


0.80 


0.39 


8 


4 


8 


0.80 


0.39 


9 


2 


10 


0.80 


0.37 


10 


5 


9 


0.75 


0.35 



5 

After calculating the performance of the next combination 
Fz^s and Fz,io (Table 14) the stack is updated if the 
performance is superior to the performance of the last 
10 entry in the stack. In the example the current feature 

combination F^^q and Fz^io is ranked at position 5 and the 
old position 10 falls out of the Stack. (Table 15) . 

Table 14: Current evaluation: 

15 



First 


Second 


Recall 


Sharp- 


feature 


feature 


Rate 


ness 


value 


value 






8 


10 


0.90 


0.42 
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Table 15: Updated Ust after evaluation feature combination 8110. 



FOS. 


First 
feature 
value 


Second 
feature 
value 


Recall 
Rate 


Sharp- 
ness 


1 
1 


er 
O 


10 


0.95 


0.52 


2 


6 


7 
/ 




C\ AO 


3 


4 


9 


0.90 


0.45 


4 


7 


10 


0.90 


0.42 


5 


8 


10 


0.90 


0.42 


6 


6 


9 


0.85 


0.43 


7 


5 


7 


0.85 


0.40 


8 


7 


8 


0.80 


0.39 


9 


4 


8 


0.80 


0.39 


10 


2 


10 


0.80 


0.37 



Table 16: Stack after testing all combination with two features. 



Pos. 


First 
feature 
value 


Second 
feature 
value 


Recall 
Rate 


Sharp- 
ness 


1 


6 


10 


0.95 


0.52 


2 


6 


7 


0.95 


0.48 


3 


4 


9 


0.90 


0.43 


4 


7 


10 


0.90 


0.42 


5 


8 


10 


0.90 


0.40 


6 


6 


9 


0.85 


0.43 


7 


5 


7 


0.85 


0.40 


8 


9 


10 


0.80 


0.41 


9 


7 


8 


0.80 


0.39 


10 


4 


8 


0.80 


0.39 



10 



15 



Proceeding now to Step 3, all combinations which are 
stored in table 16 (the best 10 pairs) are successively 
combined with all features not previously included in this 
pairing of features. Features for which low measures of 
quality have been calculated in the appraisal of the 
feature pairs can thus be re-included in the selection 
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process. Tables 17-19 show phases in Step 3 
consideration for three Features. 



Table 17 : All possible combination of the best pair F, 
Fz,io with all available features. 



6 1 


10 


1 


Fz,6 » 


Fz,lO/ 


and 


Fz,i 


6 


10 


1 2 


Fz, 6 / 


Fz,10/ 


and 


Fz,2 


6 


10 


3 


Fz,6/ 


Fz.io/ 


and 


Fz,3 


6 


10 


1 4 • 


Fz,6» 


Fz.io/ 


and 


Fz,4 


6 


10 


1 5 




Fz.io/ 


and 


Fz,5 


6 


10 


1 7 


F2,6 / 


Fz.iOf 


and 


Fz,7 


6 


10 


1 8 


Fz,6/ 


Fz.iOf 


and 


Fz,8 


6 


10 


1 9 


Fz,6^ 


Fz.io* 


and 


Fz,9 



Table 18: Possible combinations of the stack pairs with 
15 all available features . 



1. 


6 


10 1 


(1, 


2, 


3, 


4, 


5, 


7, 8, 9) 


2 . 


6 


7 1 


(1, 


2, 


3, 


4, 


5, 


8, 9) 


3 . 


4 


9 1 


(1, 


2, 


5, 


6, 


7, 


8, 10) 


4. 


7 


10 1 


(1, 


2, 


3, 


5, 


8, 


9) 


5. 


8 


10 1 


(1, 


2, 


3, 


4, 


5, 


9) 


6. 


6 


9 1 


(1, 


2, 


3, 


4, 


8, 


10) 


7. 


5 


7 1 


(1, 


2, 


3, 


4, 


8, 


9, 10) 


8. 


9 


10 1 


(1, 


2, 


3, 


4, 


5) 




9. 


7 


8 1 


(1, 


2, 


3, 


4, 


9, 


10) 


10. 


4 


8 1 


(1, 


2, 


3, 


9, 


10) 
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Table 19: Stack after testing all combination with three features. 



Pos. 


First 
feature 
value 


Second 
feature 
value 


Third 
feature 
value 


Recall 
Rate 


Sharp- 
ness 


1 


6 


10 


5 


1.00 


0.60 


2 






9 


1.00 


0.58 


3 


6 


10 


7 


0.95 


0.56 


4 


6 


7 


3 


0.95 


0.52 


5 


6 


7 


9 


0.95 


0.50 


6 


6 


10 


5 


0.90 


0.50 


7 


4 


9 


5 


0.90 


0.48 


8 


6 


10 


7 


0.90 


0.47 


9 


4 


9 


6 


0.85 


0.49 


10 


6 


7 


8 


0.85 


0.48 



10 



If the algorithm selects more then three features, the 
process is repeated (Step 3). A criteria is used to either 
end the process and accept a set of feature combinations 
or to enhance the feature set to four, five, six, etc. 
features until an acceptable level of membership 
prediction is achieved. 



15 



20 



25 



Variation of the stack size is a tuning parameter for the 
system. In this regard, and due to the linear effect of 
the stack size, the computing time can be shortened 
considerably by reducing the list length. For example, at 
a stack size = 10, only the 10 best individual features 
are used in the second stage to form new feature 
combinations. However, as. these are again combined with 
all N' features, all features will continue to take part 
in the selection process, even if they do not belong to 
the best individual features. As quality in stack 
performance and the respective stack size tentatively 
depends considerably on the particular problem instance, a 
recommendation can, of course, only be given via the 
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selection of the parameter list length (number of 
solutions to be pursued) . However, as a general rule, 
according to the experience of the inventors, a sensible 
compromise between optimization of the computing time and 
5 the finding of a sub-optimum set of features is achieved 
with a stack size of preferably between 20 and 50 feature 
candidate coiT±)inations . 

End of Example 2 

10 

Figure 2 0 presents detail in the neural network (NN) 
method of classifying and in evolutionary feature 
selection. Evolutionary Feature Selection Process 1900 
shows a process of use for the evolutionary feature 

15 selection process; the classifier used is a neural 

network, but, in an alternative embodiment, the weighted 
distance classifier described in Progressive Feature 
Selection Process 1800 is used along with the evolutionary 
selection process. In Neural Network Initiation Step 

20 1902, a particular neural network for use with a sample 

signal set given a primer configuration and the number of 
layers and neurons per layer are defined- In Neural 
Network Initial Fitness Step 1904, an initial feature set 
is defined to establish the scope of the network, and 

25 fitness of the neural network is evaluated against the 
initial feature set. In Neural Network Configuration 
Decision 190 6, the fitness of Neural Network Initial 
Fitness Step 1904 is examined against a performance 
threshold to define acceptability of the neural network 

30 configuration. If the decision result is NO, Neural 

Network Configuration Decision 1906 terminates to Neural 
Network Reconfiguration Step 1908. If the decision result 
is YES, Neural Network Configuration Decision 1906 
terminates to Primary Random Feature Set Generation Step 
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1910. In Neural Network Reconfiguration Step 1908, if the 
fitness of Neural Network Configuration Decision 1906 is 
insufficient, the neural network configuration is examined 
and modifications are proposed. if the result of Feature 
5 Set Size Decision 1926 is YES, the feature set size is 

decreased and the neural network configuration is examined 
and modifications are proposed. NN Reconfiguration Step 
1908 then terminates to Neural Network Initiation Step 
1902 for modification of the neural network configuration. 
10 In Primary Random Feature Set Generation Step 1910, 
following acceptability of the neural network 
configuration in Neural Network Configuration Decision 
1906, feature subsets are generated using random feature 
selection. in Feature Set Ranking Step 1912, each feature 
15 subset is used (a) to train the neural network and derive 
a weighting matrix and then (b) to use the particular 
derived weighting matrix parameter instance in Neural 
Network Parameter Instance 912 to evaluate the sample 
vectors in predicting their memberships. The feature 
20 subsets are then ranked according to their prediction 
capability. in Feature Set Decision 1914, each new 
feature subset is evaluated for classification prediction 
fitness. If sufficient fitness prediction is not achieved 
by any feature set, then the process proceeds to Feature 
25 Subgroup Selection Step 1918.- if sufficient fitness 
prediction is achieved by any feature set, then the 
process proceeds to Neural Network Feature Set Acceptance 
Step 1916; and the feature set defines the (sub-optimal) 
feature combination for use in NN Real-Time Parameters 914 
30 for the particular signal. In Feature Subgroup Selection 
Step 1918, a best -performing subgroup of the ranked 
feature subsets of Feature Set Ranking Step 1912 are 
selected for further modification; each of these feature 
subsets in the subgroup is referred to as a -parent 
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individual". In Feature Subgroup Crossover Step 1920, 
"'parent individuals" exchange certain features to define 
"new individuals" - this process is termed as '"crossover". 
In Feature Subgroup Mutation Step 1922, the ''new 
5 individuals" of Feature Subgroup Crossover Step 1920 are 
further modified as to features by exchanging a specific 
number of features which were not included in the initial 
set of features evaluated in the feature subsets of 1912 
with features in the "new individuals" - this process is 

10 termed as "mutation" . In Feature Set Reconfiguration Step 
1924, the inferior-performing subgroup of the ranked 
feature subsets of Feature Set Ranking Step 1912 are 
replaced with the "new individuals" so that a new set of 
feature subsets (the "parent individuals" and the "new 

15 individuals") is available. The generation counter is 

then incremented to designate a new generation of feature 
subsets for consideration. In Feature Set Size Decision 
1926, change in the feature set size in view of the 
predictive capability of the prior generation is 

20 considered. This decision is determined by operating 

technician input via Human Interface Logic 412 interfacing 
or, in an alternative automated embodiment, from 
interaction with a rule set. If the decision result is 
NO, Feature Set Size Decision 1926 terminates to Feature 

25 Set Ranking Step 1912. If the decision result is YES, 
Feature Set Size Decision 1926 terminates to Neural 
Network Reconfiguration Step 1908. 

An example of the evolutionary selection method according 
30 to the preferred embodiments is described in conjunction 
with reference to Figures 21A, 21B, 21C, and 21D which 
show evolutionary method steps and data sets 2800; Figures 
21A-21D also provide diagrams showing affiliations between 
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data variables and data values between dataset instances 
discussed in Example 3 . 

Example 3 

5 

In Step 1, setup of (1) a population size for feature 
combinations (where each combination is an « individual " in 
the population), (2) a feature set "gene pool" for the 
population, and (3) the number of feature «genes" per 
10 "individual" is defined. m this example, the feature 

«gene pool" has a Maximum Set Size of F,,i f,,io. An 

opening Minimum Set of 2 features F,,, - p,.^ for each 
individual is defined. a set of 5 individuals in the 
population is defined. 



15 



20 



25 



30 



Respective to notation, «z" is the Object number for a 
particular individual having a feature set and membership 
in a class (that is when z is expressed as a numeric 
value, then F^,^ is considered to have a specific 
quantitative value in the example; when z is expressed as 
the textual «2", then F,,, is a logically identified 
variable representing a classifying feature in the 
example). An Object, therefore, is a feature vector and 
affiliated class membership value as a combination. 

Proceeding to Step 2, the 5 individuals (note that the 
^individuals" of Table 20 are defined at the datalogical 
level of variables rather than at the level of specific 
measured Objects) with the selected minimum number of 
features (the 2 feature «gene combinations" of Step 1) are 
defined as a set of feature variables from the feature 

"gene pool" of F,,x f,,io in a random manner to form Table 

20 (further reference to Dataset 2802 of Figure 21A) . 
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Table 20 



Fz.i Fz,8 


Combination 1 - forming 
Individual 1 


Fz.4 Fz,io 


Combination 2 - forming 
Individual 2 


Fz,6 Fz,2 


Combination 3 - forming 
Individual 3 


Fz,3 Fz,i 


Combination 4 - forming 
Individual 4 


Fz,5 Fz,9 


Combination 5 - forming 
Individual 5 



5 



In Step 3 , the new feature combinations are used in 
relating to the Learning Data Set (Samples 2804, 2806) in 
Learning Database 13 02 so that prior combined measurements 

10 of feature values and membership value combinations are 
acquired for training a classifier. In this first pass, 
(the Minimum Set of) 2 features Fz,x - Fz,y for each 
individual define a Feature Value Couplet in the Learning 
Data Set. In this example, essentially the simplest case, 

15 2 measurements (Sample A 2804 and Sample B 2 806) from the 
learning database are recovered showing past human 
evaluations of two measured situations (the evaluations 
being expressed quantitatively as Human Expert Membership 
Values) using Features 1-10 respective to a Membership 

20 Class A: 

Fi^i Fi,io having a Hximan Expert Membership Value 1 

F2,i..»...-....".F2,io having a Human Expert Membership Value 0 

Human Expert Membership Value ''1'' or ^'0" indicates, 
respectively, whether or not the particular Feature Value 
25 combination measured instance (the Feature Value Couplet 
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of this first pass) belongs to Class A. Two Objects in 
the database (note again that each F^,^ represents a 
quantitative value from a feature respective to' a sample 
from the learning database) are read into the evolutionary 
selection method. Note again that only two feature values 
of the possible 10 in any one sample Object are used in 
this first evaluation. 



10 



15 



20 



25 



30 



Proceeding to Step 4, "weight adaptation" is performed to 
associate (a) data values from learning with (b) the 
combinations of features identified from random selection. 
Reviewing Steps 2 and 3, Table 20 was used to define all 
relevant feature values; then each relevant class 
membership is also affiliated with each Feature Value 
couplet respective to the learning database as shown (see 
Table 21 and Dataset 2808 of Figure 21A for the Feature 
value Couplets of this first pass with their associated 
Human Expert Membership Values) . a consideration of the 
connections between Dataset 2802, Dataset 2808, and 
Learning Database 1302 in Figure 21A shows datalogical 
nexus in this regard. In performing "weight adaptation" 
in this first pass, the neural network is trained 
respective to all of the Feature Value Couplets and their 
affiliated Membership Values shown in Table 21"; or, 
alternatively, the Weighted Distance Classifier has a set 
of eigenvalues and eigenvectors defined respective to all 
the Feature Value Couplets and their affiliated Membership 
Values shown in Table 21 and Dataset 2808. The Neural 
Net, then, is trained according to the values of Table 21; 
or, alternatively, the Weighted Distance Classifier is 
trained according to the values of Table 21. The training 
step is shown in Figure 21A as Derive Classifier Operation 
2810. Derive Classifier Operation 2810 obtains values 
from Column 2812, Column 2814, and Column 2816 of Dataset 
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2808 (note that, even as the colxomns are conveniently 
identified, the system continues to relate to each Object, 
or effective row across all columns referenced, as a 
related data entity for use in classification) . 

5 Table 21 



First 


Second 


Membership Value 


Feature 


Feature 


Measured from 


Value 


Value 


Human Expert Input 


Fm 


F1.8 


1 


Fo,! 


F2,8 


0 


F,.4 


Fi.io 


1 


F2.4 


F2.10 


0 


F1.6 


F,.2 


1 


F2.6 


F2,2- 


0 


F1.3 


F,., 


1 


F2,3 




0 


F,.5 


F1.9 


1 


Fa.3 


F2.9 


0 



In Step 5, either (1) the trained Neural Network or, 
10 alternatively, (2) the trained Weighted Distance 

Classifier is used to generate Predicted Membership Values 
according to the quantitative Feature Value Couplets of 
Table 21. This is shown as Derive Predicted Membership 
Values Operation 2818 in Figure 21A. In this regard, 
15 values from Column 2812 and Column 2814 of Dataset 2808 
are read into Operation 2818 along with the Classifier 
Reference Instance (918, 912) derived in Operation 2810. 
Comparison of the Predicted Membership Value defined by 
the trained NN (trained WDC) to the Human Expert 
20 Membership Value originally measured is then performed. 

This is shown figuratively in Table 22 and in Dataset 2 820 
of Figure 21B. Note that Dataset 2820 acquires its values 
from Column 2812, Column 2814, and Column 2816 of Dataset 
2808 and also from Operation 2818 (note again that, even 
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as the columns are conveniently identified, the system 
continues to relate to each Object, or effective row 
across all columns referenced, as a related data entity 
for use in classification) . 

Table 22 



First 

Feature 

Value 



Fi.1 
F2.1 
F1.4 

F2.4 
F1.6 
F2.6 
F1.3 

F1.5 
F2.S 



Second 
Feature 
Value 



F1.8 
F2.8 



10 



F2 2 



Membership Value 
Predicted from using 
trained classifier 
(note these are examples of 
what the newly- trained 
classifier defines as a 
Membership Value set) 



0 



0 



Membership Value 
Measured from Human 
Expert Input 
(Table 21 value) 



_0_ 
1 

_0_ 

1 

_0_ 

1 

_0_ 

1 

0 



10 



15 



From examination of Table 22 and Dataset 2 820, conclusions 
(shown in Table 23) about the classification usefulness of 
individuals of Table 20 are drawn respective to the 
proposed plan of randomly-defined Table 20; these 
conclusions are based upon the performance (in this first 
pass) of the Feature Value Couplets and affiliated 
Membership Values recovered as Objects from the Learning 
Database according to the defined individuals of Table 20 
when used by the classifier deployed. 
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Table 23 



Fz.1 


Fz,8 


50 percent correct in predicting since, as shown in Table 
22, one sample was properly classified and one sample 
was not properly classified 


Fz.4 


Fz.io 


0 percent correct in predicting since, as shown in Table 
22, both samples were improperly classified 


Fz.6 


Fz.2 


100 percent correct in predicting since, as shown in Table 
22, each sample was properly classified 


Fz,3 


Fz,i 


100 percent correct in predicting since, as shown in Table 
22, each sample was properly classified 


Fz,5 


Fz.9 


0 percent correct in predicting since, as shown in Table 
22, both samples were improperly classified 



5 

In Step 6, the five individuals of Table 20 are ranked 
according to their performance in predictive 
classification. Table 23 now is rearranged into Table 24. 
Da t as at 2 822 of Figure 2 IB also shows the data arrangement 

ib of Table 24. In tracing the data-linkages shown between 

Dataset 2820 and Dataset 2822, the specific considerations 
of the conclusive (rightmost column) column of Table 24 
and Dataset 2 822 respective to the data in Table 22 
(Dataset 2820) are demonstrated. Note that Table 23 is 

15 not shown as a dataset in the Figures . 



Table 24 



Fz,6 


Fz,2 


100 percent correct in predicting since, as shown in 
Table 22, each sample was properly classified 


Fz,3 


Fz,! 


100 percent correct in predicting since, as shown in 
Table 22, each sample was properly classified 


Fz.1 


Fz.8 


50 percent correct in predicting since, as shown in Table 
22, one sample was properly classified and one sample 
was not properly classified 


Fz,5 


Fz,9 


0 percent correct in predicting since, as shown in Table 
22, both samples were improperly classified 


Fz,4 


Fz.10 


0 percent correct in predicting since, as shown in Table 
22, both samples were improperly classified 
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Proceeding now to step 7, two of the con>binations 
(individuals) Of Table 20 are selected for generation of 
^'chxldren" in a set of two operations termed ^crossover" 
and ^znutation"; in this regard, and in the context of the 
defxnxtion of new "children" , the two chosen individuals 
of Table 20 are referenced as "parents". The process is 
further shown in Figure 21C. Figure 2lC reprises Dataset 
2802. in example, the P.,, - f.,, coznbination is randomly 
chosen and the F.,^ - F.., con^ination is also randomly 
chosen (note, in spite of the fact that an « individual " 
may have been a "poor performer" in the prediction 
evaluation, the "individual" is still valid as a "parent-^ 
for creating a "child" for the system) . Dataset 2826 
shows the 2 parent features sets in Figure 21C and the 
random choosing action is denoted as Operation 2824 in 
the crossover process itself (step 8 and also indicated as 
crossover 2828 in Figure 21C) the F.,, - p,,, and the « - 
features are exchanged. In crossing over, a feature 
^^gene" from each of two randomly selected "parents" in 
Table 20 is used as one of each of the child feature 
"genes" (an examination of the datalinkages between 
Datasets 2830 and 2832 as they influence Datasets 2834 and 
2836 further clarifies the crossover operation),. The 
Table 20 "generation" has now become the Table 25 
"generation" insofar as two "children" have been added to 
the original population of individuals of Table 20. 
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Table 25 



Fz.1 


Fz.8 


Individual 1 






Individual 9 


Fz,5 


Fz,2 


Individual 3 - a child of Table 20 parents Fz,5 ~ F2,9 and 

Fz,6- Fz,2 


Fz.3 


Fz.1 


Individual 4 


Fz.5 


Fz,9 


Individual 5 (a parent) 


F2.6 


Fz.2 


Individual 6 (a parent) 


Fz,6 


Fz,9 


Individual 7 - a child of Table 20 parents Fz,5 - F2,9 and 

F2.6- Fz.2 



5 In Step 9, mutation of the new children of the Table 25 
generation is performed (see Mutation Operations 2846 in 
Figure 21C) . In this regard, one of Features F^.x to Fz,io 
which is not one of the feature '"genes" of the new 
children in the generation of Table 24 is randomly 

10 selected for use in substitution (in each child) for a 

feature gene directly inherited from one of the parents in 
Operations 2838 and 2840. Operations 2842 and 2844 then 
execute to randomly discard one gene from each Child 
(Datasets 2834 and 2836, with the discarded feature 

15 '"genes" shown as Blanks 2856 and 2858 of respective 
Datasets 2848 and 2850) . The Features selected for 
substitution are then substituted the discarded feature 
""genes" (Blanks 2856 and 2 858) in the children of Table 
25. In example. Individual 7 is mutated to replace F^.s 

20 with Fz,7, and Individual 3 is mutated to replace Fz,2 with 
F2,4 (see the movements from Dataset 2848 and 2850 into 
Datasets 2852 and 2854 with the inclusion of the features 
selected in Operations 283 8 and 2840) . The Table 25 
""generation" has now mutated into the Table 26 (Dataset 

25 2856) ""generation". The combination of Datasets 2802, 

2852, and 2854 into Dataset 2856 is diagrammed in Figure 
21D. 
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Table 26 



■ZA 



^Z.5 



''z.5 



"2.6 



^2.7 



^2.4 



Fz.1 



F: 



2,9 



Individual 1 



Individual 2 



Individual 3 - a now mutated child of Table 20 parents F3,5 

- Fz.9 and Fz.6 - Fz-Z 

Individual 4 ~ ' 



Individual 5 (a parent) 



Individual 6 (a parent) 



Individual 7 - a now mutated child of Table 20 parents 

Fz.9 and Fz.6- F2.2 



In Step 10, which can be termed "survival of the most 
fit", the two worst-performing individuals of Table 20 
(Fz,4 - Fz,io & Fz.5 - Fz.g) are replaced by the two new 
mutated children of Table 26 in Operation 2858; put 
another way, since only 5 combinations (individuals) are 
permitted in the performing population of a particular 
"generation", a new Table for evaluation is defined from 
the three best performing "old folks" of Table 20 and the 
2 new "mutated children" {who are too "young and untested" 
to be designated as either good or bad performers yet, but 
who are presumed to have predictive potential until tested 
otherwise) of Table 26. The process is further 
appreciated from the diagram of Figure 21D which shows 
Dataset 285 6 modified by Operation 2858 to remove 
individuals F.,4 - F,,,o & F,,5 - F,., according to the inputs 
of reprised Dataset 2822. The removal of individuals F^,^ 

Fz,io & Fz,5 - Fz,9 is shown with respective Remove 2860 
and Remove 2862 designators. The other individuals of 
Database 2822 are retained according to designator Retain 
2864. The new Table for evaluation is shown as Table 27 
and as Dataset 2866: 
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